RAG Eval

Evaluate RAG systems by diagnosing retrieval and generation separately. A single "RAG accuracy" number hides whether the problem is finding the right documents or using them correctly. This skill separates them so you know what to fix.

When to Activate

• User has a RAG pipeline (retriever + generator) with traces
• User wants to know if their RAG system hallucinates
• User is optimizing chunking strategy and needs before/after comparison
• User wants to build a RAG evaluation dataset

Checklist

You MUST create a task for each item and complete them in order: