Weekly scorecards › 2026-47
Install scorecard: week 2026-47
From 2026-11-17 to 2026-11-17 (1 nightly run), 911 of 1050 judgeable installs passed on the last night (86.8%). 2 confirmed broke, 0 really fixed, and 6 flip-flopped, which we refuse to count as news. The most reliable agent was Claude Code at 93.5%.
Agent reliability ranking
| # | Agent | Pass rate | Installs passed | Flaky | Needs a key |
|---|---|---|---|---|---|
| 1 | Claude Code | 93.5% | 343/367 | 2 | 5 |
| 2 | Grok Build | 92.4% | 353/382 | 3 | 5 |
| 3 | Codex | 83.5% | 96/115 | 0 | 5 |
| 4 | Cursor | 66% | 33/50 | 2 | 5 |
| 5 | Pi | 63.2% | 86/136 | 2 | 5 |
Standout of the week
Angular Testing: clean in 5 agents with zero flakes. Writes, fixes and reviews Angular tests following the Pragmatic Angular Testing approach: fakes over mocks, real collaborators by default, components tested through the DOM. Targets Vitest and also ap
Confirmed broke (2)
- Sap Fiori MCP Server (2 agent-nights)
Really fixed (0)
Nothing came back after two or more bad nights.
Flaky (6)
Pass one night, fail the next. Not broken, not fixed, just moody.
25 installs failed only because they need an API key our sandbox doesn't have. We count those separately.
Built from the nightly daily reports. Check a tool for today · How we test
Get this scorecard by email every Tuesday
Free, every Tuesday: this scorecard plus new skills and what broke. The daily report stays on the site, no daily emails.
Loading the signup form… or subscribe on Beehiiv
Form not loading? Subscribe on Beehiiv →