langsmith-observability
Pass
Audited by Gen Agent Trust Hub on Feb 17, 2026
Risk Level: SAFEEXTERNAL_DOWNLOADSDATA_EXFILTRATION
Full Analysis
- EXTERNAL_DOWNLOADS (SAFE): The skill installs the
langsmithpackage via pip. - Evidence: Found
langsmith>=0.2.0in the dependencies field. - Trust: LangSmith is maintained by the
langchain-aiorganization, which is a recognized trusted source in the AI ecosystem. - DATA_EXFILTRATION (SAFE): The skill transmits application execution traces, including prompt inputs and model outputs, to the external domain
smith.langchain.com. - Evidence: The skill utilizes
@traceabledecorators and the LangSmithClientto send data to the cloud service. - Mitigation: This activity is the primary intended function of the skill. The documentation includes a specific remediation example using the
process_inputshook to sanitize sensitive information (e.g., passwords) before transmission. - CREDENTIALS_UNSAFE (SAFE): The skill utilizes environment variables for authentication and does not contain hardcoded secrets.
- Evidence: The documentation correctly instructs users to set
LANGSMITH_API_KEYas an environment variable and uses placeholders in examples. - INDIRECT_PROMPT_INJECTION (SAFE): The skill presents an attack surface by processing untrusted prompt data.
- Ingestion points: Prompts and queries passed to traced functions in
SKILL.md. - Boundary markers: Not explicitly defined in the trace wrapper code.
- Capability inventory: Data transmission to external observability API.
- Sanitization: Explicit guidance provided in the 'Process inputs/outputs' section for filtering sensitive content.
Audit Metadata