paper-draft-consistency-editor
Paper Draft Consistency Editor
Check and fix whether a paper draft is internally coherent. This skill is an editor pass, not a reviewer simulation and not a first-draft writer. It makes the title, abstract, introduction, methods, results, figures, tables, captions, related work, limitations, and conclusion agree with the paper's active claims and evidence.
Use this skill for:
- title/abstract/intro/conclusion consistency
- contribution bullet to experiment mapping
- claim strength drift across sections
- terminology, method name, dataset name, baseline name, metric name, and notation consistency
- writing-layer consistency: layout, fluency, argument, technical consistency, style consistency, venue adaptation, and polish edits stay within their intended permissions
- figure/table/caption/main-text alignment
- result prose that no longer matches updated numbers
- unresolved
PROVISIONAL-RESULTorPR-###placeholders - checking whether the draft follows
paper/.agent/writing-contract.md - producing a consistency report or directly editing narrow inconsistencies
Do not use this skill to decide the paper's positioning from scratch. Use paper-positioning-planner for that. Do not use it to write major new prose. Use paper-writing-memory-manager to record stale locations, dependency conflicts, and open writing threads found during consistency checks. Use paper-writing-assistant after consistency issues are identified. Do not simulate hostile reviewers; use paper-reviewer-simulator for acceptance-risk critique.
Skill Directory Layout
<installed-skill-dir>/
├── SKILL.md
├── references/
│ ├── consistency-rules.md
│ └── edit-protocol.md
└── templates/
└── consistency-report.md
Progressive Loading
- Always read
references/consistency-rules.md. - Read
references/edit-protocol.mdbefore editing paper source. - Use
templates/consistency-report.mdfor substantial reports. - Read
paper/.agent/writing-contract.mdwhen present. - Read
paper/.agent/writing-memory/,paper/.agent/writing-style.md,paper/.agent/writing-style-lessons.md,paper/.agent/notation-contract.md,paper/.agent/paper-evidence-board.md,paper/.agent/provisional-results.md, and rootmemory/claim-board.md/memory/evidence-board.mdwhen present. - Read figure/table maps or visual-style files when checking figures and tables.
Core Principles
- Preserve the selected paper story. Do not silently reposition the paper.
- Distinguish inconsistency from scientific weakness. The goal is coherence, not acceptance-risk scoring.
- Prefer the current writing contract and evidence board over local inference.
- Fix low-risk naming, reference, and wording drift directly when requested.
- For claim or evidence drift, report the issue and propose the smallest safe edit.
- Do not strengthen claims to resolve inconsistencies. Weaken, narrow, or route to missing evidence instead.
- Preserve LaTeX commands, labels, citations, math, macros, comments, and formatting unless the edit directly concerns them.
Step 1 - Locate Draft and Contract
Find:
- paper root:
paper/, current directory, or user-provided path paper/.agent/writing-contract.mdor.agent/writing-contract.mdpaper/.agent/paper-evidence-board.mdpaper/.agent/provisional-results.md- source files:
main.tex,paper.tex,sections/*.tex, appendix, figure wrappers, table files - root memory:
memory/claim-board.md,memory/evidence-board.md,memory/action-board.md
If no writing contract exists, still run the consistency pass from the draft, but recommend paper-writing-contract-planner.
Step 2 - Choose Mode and Scope
Modes:
audit: produce a report with issues and proposed fixesedit: make narrow source edits for clear inconsistenciesreport: save a report underpaper/.agent/draft-consistency-report.md
Scopes:
full: all checksclaims: title/abstract/intro/result/conclusion claim alignmentterms: names, notation, metrics, datasets, baselinesfigures: figures, captions, callouts, visual jobsresults: tables, numbers, result prose, provisional placeholders
Default to audit and full unless the user asks for direct edits.
Step 3 - Build the Draft Story Map
Extract a compact map:
## Draft Story Map
- Title promise:
- Abstract claims:
- Intro thesis:
- Contribution bullets:
- Method claims:
- Experiment claims:
- Figure/table takeaways:
- Limitation scope:
- Conclusion claims:
- Active contract:
Mark claim IDs such as CLM-### when available. If IDs are missing, use local labels like CLM-DRAFT-001.
Step 4 - Run Consistency Checks
Read references/consistency-rules.md.
Check:
- Does the title promise match the abstract and intro thesis?
- Do abstract results appear in the experiments/results section?
- Do intro contribution bullets map to experiments, figures, tables, theorem, citation, or artifact evidence?
- Are claim strengths consistent across abstract, intro, results, conclusion, and limitations?
- Do method names, dataset names, baseline names, metric names, symbols, and notation stay consistent?
- Are figure/table captions aligned with main-text interpretation?
- Are result numbers and directions consistent across tables, captions, and prose?
- Are provisional placeholders still present?
- Does related work define the same novelty boundary as intro contributions?
- Do limitations narrow exactly the right claims?
- Do layout, fluency, or polish edits accidentally change claim strength, notation, evidence scope, or venue positioning?
- Do argument or venue-adaptation edits update the writing contract or mark dependent sections stale?
- Do style-consistency edits follow
writing-style.mdor record a new lesson/preference?
Classify each issue:
blocking: could make the draft misleading or unsupportedmajor: materially confuses the paper storyminor: naming, wording, or local flow inconsistencystyle: polish issue that does not affect meaning
Step 5 - Propose or Apply Edits
Read references/edit-protocol.md.
For each issue, choose:
direct-edit: safe local wording/name/reference fixrewrite-request: needspaper-writing-assistantcontract-update: needspaper-writing-contract-plannerevidence-update: needspaper-evidence-boardwriting-memory-update: needspaper-writing-memory-managerto record dependency conflicts, stale locations, or closed threadsstyle-memory-update: needspaper-writing-memory-managerto record a writing-layer lesson, preference, project contract, protected invariant, or notation ruleexperiment-action: needsexperiment-design-plannerdiagnosis: needsresult-diagnosisleave-note: intentional inconsistency or unresolved decision
When editing:
- edit the smallest relevant TeX or Markdown file
- keep citations, labels, refs, macros, and math intact
- avoid broad paragraph rewrites unless explicitly requested
- do not replace provisional placeholders with unverified final prose
Step 6 - Produce Report
Use templates/consistency-report.md for substantial audits.
If saving and no path is specified, use:
paper/.agent/draft-consistency-report.md
Report:
- summary of draft story
- issue table sorted by severity
- direct edits made, if any
- unresolved consistency risks
- required contract/evidence/writing follow-ups
- provisional placeholders found
Final Sanity Check
Before finalizing:
- no claim was strengthened without evidence
- source edits are narrow and traceable
- unresolved issues are routed to the right skill
- provisional placeholders are listed
- the final response distinguishes edits made from recommendations
More from a-green-hand-jack/ml-research-skills
project-init
Initialize an ML research project control root. Use for paper/code/slides repos, shared memory, GitHub Project alignment, agent guidance, worktree policy, and lifecycle handoffs.
37project-sync
Sync verified code-side experiment results into paper memory. Use when logs, reports, run docs, or user-confirmed metrics should become paper-facing evidence.
36add-git-tag
Create annotated Git milestone tags. Use when completing a phase, releasing a version, or marking a research checkpoint.
36update-docs
Refresh project documentation after code changes. Use after implementing features, changing behavior, or preparing a milestone commit.
36init-latex-project
Initialize a LaTeX academic paper project. Use for new conference or journal papers needing templates, macros, venue preambles, and writing guidance.
36new-workspace
Create Git branches or worktrees for research code and paper versions. Use for experiments, baselines, rebuttal fixes, arXiv/camera-ready branches, and worktree memory.
36