test(e2e): add spotify capability-gap ux benchmark case

This commit is contained in:
Jiayuan Zhang 2026-02-17 01:18:06 +08:00
parent 7eb18f47fc
commit 50407918b9
3 changed files with 125 additions and 14 deletions

View file

@ -7,7 +7,7 @@ This benchmark validates the meta skill workflow for capability-gap discovery, C
- Domain: skill discovery + installation + update
- Focus: `skills/meta-skill-installer`
- Providers: default `kimi-coding` (override with `PROVIDERS`)
- Cases: 3
- Cases: 4
Case prompts are stored in:
- `scripts/e2e-skills-benchmark/cases/`
@ -19,6 +19,7 @@ The case set references real public pages from ClawHub:
- [CalDAV Calendar](https://clawhub.ai/skills/caldav-calendar)
- [Home Assistant](https://clawhub.ai/skills/homeassistant)
- [CodexMonitor](https://clawhub.ai/odrobnik/codexmonitor)
- [Spotify (gap-discovery UX flow)](https://clawhub.ai/search?q=spotify)
## Prerequisites
@ -86,6 +87,7 @@ For each run:
- `clawhub install`
- `review-skill-security.mjs`
- for case 03 also `clawhub update`
- for case 04, final response must include ClawHub + install confirmation language, and must not run `clawhub install/update` before confirmation
## Notes