benchwarmers
Installation
SKILL.md
Benchwarmers
A Benchwarmers server answers one prompt with every model in a collection at once: its members, plus explorer seats it fills with the models whose evidence is stalest. Every answer comes back under its own seat and model, with a call id. Your verdicts on those answers decide which models it seats next time, so using the bench and measuring it are the same act.
The tools are served by a running Benchwarmers itself, at its /mcp
(BENCHWARMERS_URL, default http://127.0.0.1:8122; a gateway key in
BENCHWARMERS_KEY where the server asks for one). If the tools are missing,
or the benchwarmers server shows as failed in /mcp, Benchwarmers is not
running: tell the user; do not work around it.