Weekly scorecards › 2026-43
Install scorecard: week 2026-43
From 2026-10-25 to 2026-10-25 (1 nightly run), 795 of 890 judgeable installs passed on the last night (89.3%). 0 confirmed broke, 0 really fixed, and 0 flip-flopped, which we refuse to count as news. The most reliable agent was Codex at 100%.
Agent reliability ranking
| # | Agent | Pass rate | Installs passed | Flaky | Needs a key |
|---|---|---|---|---|---|
| 1 | Codex | 100% | 65/65 | 0 | 0 |
| 2 | Claude Code | 93.6% | 338/361 | 0 | 6 |
| 3 | Grok Build | 92.4% | 306/331 | 0 | 0 |
| 4 | Pi | 65.5% | 57/87 | 0 | 0 |
| 5 | Cursor | 63% | 29/46 | 0 | 6 |
Standout of the week
Videogen: clean in 1 agents with zero flakes. AI video generator and AI video editor. Go from text to video, image to video, or script to video, then export an MP4.
Confirmed broke (0)
Nothing failed two nights running after a good night.
Really fixed (0)
Nothing came back after two or more bad nights.
12 installs failed only because they need an API key our sandbox doesn't have. We count those separately.
Built from the nightly daily reports. Check a tool for today · How we test
Get this scorecard by email every Tuesday
Free, every Tuesday: this scorecard plus new skills and what broke. The daily report stays on the site, no daily emails.
Loading the signup form… or subscribe on Beehiiv
Form not loading? Subscribe on Beehiiv →