Livenerf starts a 30-day test of whether Opus 5.5 gets worse after launch
Livenerf runs a frozen 78-question panel (from GPQA Diamond, MMLU-Pro, competition math and AIME) through headless Claude Code on a Max plan, 90 samples a day for 30 days starting September 24, 2026, with a pinned CLI and exact-match grading. The Hacker News launch thread drew 926 points and 394 comments.
Source
"livenerf is a small, boring, append-only benchmark for one question: does a model get worse after it ships?"
Published