ModelRig — probed, dated, reproducible model capability facts
Model providers declare capabilities; ModelRig measures them — and routes traffic by what models actually do, at the best price that passes your bar.
- Quickstart — define a route, call
rig.run(), get schema-validated output with cost telemetry. - Route bundles — the routes-as-code reference.
- Probes — the measurement harness: schema conformance (parses ≠ conforms ≠ values-correct), grounding, caching.
- Leaderboard — models ranked by conformance per dollar, declared-vs-probed discrepancies flagged.
Reproduce any number
npx modelrig-probes run --model deepseek/deepseek-chat --class schema
Every published result carries raw samples, fixture hashes, and a 95% confidence interval. A reproduction passes when your rerun lands inside the interval. Disagreements are contributions — file an issue.