paper-claim-audit

Installation
SKILL.md

Paper Claim Audit: Zero-Context Evidence Verification

Verify that every claim in the paper matches raw evidence for: $ARGUMENTS

Why This Exists

The executor writes experiments AND writes the paper. It "knows" what the results should be. This creates confirmation bias:

  • Rounding 84.7% up to 85.3%
  • Reporting best seed instead of average
  • Citing metrics from a different experiment config
  • Claiming "improves by 15%" when the delta is actually 12.8%

A fresh reviewer with zero prior context catches these because it has no expectations — it just compares paper text vs raw files.

How This Differs From Other Audit Skills

Skill Question it answers
/experiment-audit Is the experiment code honest? (fake GT, normalization fraud)
Related skills

More from shaun-z/auto-claude-code-research-in-sleep

Installs
1
First Seen
Apr 19, 2026