langsmith-code-eval

Malicious tool definition detected

Tool: langsmith-code-eval/EVALUATOR_REFERENCE.md Description: # Evaluator Reference ## Evaluator Function Signature ```python from langsmith.schemas import Run, Example def evaluator_name(run: Run, example: Example) -> dict: """ Args: run: Contains actual agent execution data - run.inputs: dict - inputs passed to agent - run.outputs: dict - agent outputs (structure varies by agent) example: Contains dataset example data - example.inputs: dict - inputs from dataset - example.outputs: dict - refer

Malicious tool definition detected

Tool: langsmith-code-eval/SKILL.md Description: --- name: langsmith-code-eval description: Creates code-based evaluators for LangSmith-traced agents. Use when building custom evaluation logic, testing tool usage patterns, or scoring agent outputs programmatically.

Malicious tool definition detected

Tool: langsmith-code-eval/scripts/inspect_dataset.py Description: """ Dataset Structure Inspector for LangSmith Use this to understand the structure of your dataset before building an evaluator.

Malicious tool definition detected

Tool: langsmith-code-eval/scripts/inspect_trace.py Description: """ Trace Structure Inspector for LangSmith Use this to understand the structure of your agent's traces before building an evaluator.