langsmith-evaluator

Installation
SKILL.md
LANGSMITH_API_KEY=your-api-key                        # Alternative to `langsmith auth login`
LANGSMITH_ENDPOINT=https://api.smith.langchain.com   # SDK/CLI environment
LANGSMITH_PROJECT=your-project-name                   # Default for trace/run queries only
LANGSMITH_WORKSPACE_ID=your-workspace-id              # Optional: for org-scoped keys
OPENAI_API_KEY=your-openai-key                        # For locally executed OpenAI judges
Installs
3.7K
GitHub Stars
147
First Seen
Mar 4, 2026
langsmith-evaluator — langchain-ai/langsmith-skills