langsmith-dataset

Fail

Audited by Runlayer on Mar 4, 2026

Risk Level: HIGH
Scan Summary
Max Score
91%
Files
5
Flagged
4
Chunks
11
Flagged Files (4)
langsmith-dataset/scripts/generate_datasets.pyHIGH
90.5%

Malicious tool definition detected

Tool: langsmith-dataset/scripts/generate_datasets.py [1/3] Description: #!/usr/bin/env python3 """Generate evaluation datasets from exported trace JSONLfiles.

langsmith-dataset/SKILL.mdMEDIUM
86.9%

Malicious tool definition detected

langsmith-dataset/scripts/generate_datasets.tsMEDIUM
84.0%

Tool passed security scan

Malicious tool definition detected

Tool: langsmith-dataset/scripts/generate_datasets.ts [3/3] Description: nodeIoList.length > options.samplePerTrace ) { // Random sample const shuffled = [...nodeIoList].sort(() => Math.random() - 0.5); sampled = shuffled.slice(0, options.samplePerTrace); } for (let idx = 0; idx < sampled.length; idx++) { const nodeIo = sampled[idx]; dataset.push({ trace_id: traceId, run_id: nodeIo.run_id, node_name: nodeIo.node_name, occurrence: idx + 1, inputs: nodeIo.inputs, outputs: { expected_output: nodeIo.

langsmith-dataset/scripts/query_datasets.tsMEDIUM
75.3%

Tool passed security scan

Malicious tool definition detected

Description: 0) { console.log(chalk.yellow(`No examples in dataset '${datasetName}'`)); return; } const outputPath = path.resolve(outputFile); fs.writeFileSync(outputPath, JSON.stringify(examples, null, 2)); console.log( chalk.green("✓") + ` Exported ${examples.length} examples to ${outputFile}`, ); }); // Only run CLI when executed directly (not when imported) const isMainModule = process.argv[1] && (process.argv[1].endsWith("query_datasets.ts") || process.argv[1].endsWith("query_datasets.js"))

Passed Files (1)Click to expand
langsmith-dataset/scripts/query_datasets.pyOK
33.0%

Tool passed security scan

Audit Metadata
Max File Score
91%
Classification
KNOWN_SERVER_PARTIAL_KNOWN
Files Scanned
5
Files Flagged
4
Chunks Analyzed
11
Analyzed
Mar 4, 2026, 12:32 AM
Security Audit — runlayer — langsmith-dataset