optimize-description

Optimize a skill's description through iterative eval-and-improve cycles.

$ARGUMENTS

If $ARGUMENTS is provided, use it as the skill path. Otherwise, ask the user which skill to optimize.

Steps

1. Locate the skill directory. Resolve $ARGUMENTS to an absolute path if provided.

2. Check for eval queries in .skill-eval/evals/ -- if missing, scaffold them first.

3. Ask the user to review trigger queries in eval_review.html (generated by the skill-eval pipeline).

4. Run the optimization loop:

   python3 ${SKILL_ROOT}/../skill-shaper/scripts/run_loop.py \
     --eval-set <queries> \
     --skill-path <dir> \
     --max-iterations 5 \
     --holdout 0.4
   

5. Open the live HTML report (generate_report.py) showing iteration progress.

6. When complete, display the best description and its test score.

7. Ask the user to confirm before applying the new description to SKILL.md.