triaging-visual-review-runs
Triaging visual review runs
Visual Review is PostHog's screenshot-regression product: CI captures storybook + playwright screenshots,
diffs them against committed baseline hashes, and gates the PR until every changed snapshot is resolved.
A PR with visual changes carries a visual-review GitHub status check and a required "Visual regression tests pass" job check.
Both stay red until each diffed snapshot is approved and finalized, tolerated, or quarantined, and the job re-runs:
finalize does that for approvals, recompute-create for tolerations and quarantines. The VR UI offers the same actions.
A PR from a fork is the exception: it gets no Visual Review run at all.
See Fork PRs have no Visual Review run.
This skill teaches an agent how to answer the questions a human reviewer would actually ask, by chaining
the VR MCP tools — instead of reaching for gh pr view and tab-hopping to the VR web UI. The read tools
cover status / scope / history / triage. An agent may resolve flakes on its own, with a quarantine or, rarely, a toleration.
It may not ship a visual change on its own: finalize-create commits the baseline and needs explicit per-run human confirmation.
Decide first
Gather the evidence with Is the diff real or unrelated? and the flake check, then take the first row that matches each changed snapshot.