LangSmith Evaluators
Fail
Audited by Runlayer on Mar 2, 2026
Risk Level: HIGH
Scan Summary
Flagged Files (3)
langsmith-evaluators/scripts/upload_evaluators.pyHIGH
92.4%
Malicious tool definition detected
langsmith-evaluators/scripts/upload_evaluators.tsMEDIUM
88.6%
Malicious tool definition detected
langsmith-evaluators/SKILL.mdMEDIUM
76.1%
Malicious tool definition detected
**Run your agent** on sample inputs and capture the actual output 2. **Inspect the output** - print it, query LangSmith traces, understand the exact structure 3.
Audit Metadata