SlopCodeBench: GPT-6 Astra leads strict pass rate, Opus 5.5 does better at medium than xhigh

On 36 problems and 196 checkpoints, GPT-6 Astra at xhigh had the best strict pass rate (16.33%), GPT-6.1 Sol medium 14.80% and Opus 5.5 medium 14.29%. Opus 5.5 at xhigh scored lower (12.76%) at 4.22 times the cost. The Hacker News thread drew 303 points and 120 comments.

Who is affected:

Teams choosing effort levels for long coding tasks with changing requirements.

What to do:

Test medium effort before paying for xhigh.