configure-metrics
Configure Metrics
Guide the user through selecting, creating, and attaching evaluation metrics for their AI agent using the coval CLI. Follow the phases below in order.
If $ARGUMENTS contains an agent name or use case, use it to skip the relevant question in Phase 1.
Phase 0: Preflight + Inventory
Step 1: Check authentication
coval whoami
If not authenticated, guide the user:
coval login
This prompts for an API key. Get one at https://app.coval.dev/settings (Organization > Manage > API Keys).
More from coval-ai/coval-external-skills
onboard
>
15launch-run
Launch a Coval evaluation run against an AI agent. Use when user wants to start an evaluation, test an agent, or run simulations.
13coval-resources
Comprehensive overview of ALL Coval platform resources, their hierarchy, relationships, API endpoints, and ID formats. Use when user asks about Coval resources, data model, how things relate, what endpoints exist, or needs context about the platform structure before making API calls.
13quick-eval
Full evaluation workflow - launch a run, watch progress, and summarize results. Use for end-to-end agent testing.
13download-audio
Download audio recordings from Coval voice simulations. Use when user wants to listen to or analyze call recordings.
13watch-run
Monitor a Coval run's progress with live updates. Use when user wants to check run status or wait for completion.
13