Run Test Suite
Execute every case against a model endpoint. Tests run sequentially and results persist as they complete, so a free-tier run can be watched or resumed.
⚙️ Configuration
🎲 Flakiness Check
same test, N times, same configTemperature and seed are pinned on every run, but providers are not fully deterministic. Repeating one test measures what variance is left — a test whose verdict flips between identical runs cannot be used as a regression gate.