[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-claude-code-and-opus-55-sweep-half-a-new-game-benchmark":10,"sections":41},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":36,"feedback":40,"feedback_at":22,"cost_usd":40,"total_tokens":40},10923,"claude-code-and-opus-55-sweep-half-a-new-game-benchmark","Claude Code and Opus 5.5 Sweep Half a New Game Benchmark","A new benchmark pitting AI agents against archived human-written game programs found only one model-harness combo could win anything, and only half the time.","A new AI benchmark shows only one agent setup can out-learn human-written game bots, and only for half the games.\n\nResearchers built AAArena, a testbed of 12 adversarial games stocked with 1,920 archived human-written programs, and ran it like a real competitive ladder. Agents had to read each game's rules, pick opponents, study match replays, and rewrite their own strategy code within a fixed budget of matches and evaluation time, all without changing the underlying model's weights. Among the model and harness configurations tested, only Opus 5.5 running inside Claude Code won gold medals, taking first place in 6 of the 12 ladders. Every other configuration evaluated won zero golds, and no one, including that top setup, topped the remaining 6 ladders.\n\nThat split is the real result here, not the win count. It separates the question of whether a model can learn a strategy from whether it can write working code, and the answer is: sometimes, and only for the easier half of the field. The researchers also found performance fell as a game's rules got more complex, and that agents learned faster with richer feedback and when they could choose easier opponents to face first.\n\nA 6-of-12 record against programs humans coded by hand is a real result, but it's a long way from the clean sweep a passing glance at the leaderboard might suggest.","[\"ai agents\",\"benchmarks\",\"claude code\",\"game ai\"]","2026-10-09T04:00:00.000Z","2026-10-09T21:51:51.295Z","2026-10-09T21:51:56.569Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"Cut the unsupported 'decades of accumulated human strategy' claim, which has no basis in the source, and rework the headline so it doesn't imply 'AI coding agents' broadly succeeded when only the specific Claude Code\u002FOpus 5.5 configuration won any golds while every other evaluated configuration won zero.","resolved","ai",[32,33,34,35],"ai agents","benchmarks","claude code","game ai",[37],{"name":38,"url":39},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2610.12341",0,{"sections":42},[43,46,50,55,60,64,68,73,78,83,87,92,97,102],{"name":44,"slug":30,"count":45,"latest_published_at":18},"AI",6734,{"name":47,"slug":48,"count":49,"latest_published_at":18},"Security","security",931,{"name":51,"slug":52,"count":53,"latest_published_at":54},"Policy","policy",486,"2026-10-08T22:40:11.000Z",{"name":56,"slug":57,"count":58,"latest_published_at":59},"Deals","deals",474,"2026-10-08T22:00:00.000Z",{"name":61,"slug":62,"count":63,"latest_published_at":18},"Hardware","hardware",232,{"name":65,"slug":66,"count":67,"latest_published_at":18},"Science","science",193,{"name":69,"slug":70,"count":71,"latest_published_at":72},"Consumer Tech","consumer-tech",181,"2026-10-08T23:26:35.000Z",{"name":74,"slug":75,"count":76,"latest_published_at":77},"Startups","startups",117,"2026-10-08T16:45:00.000Z",{"name":79,"slug":80,"count":81,"latest_published_at":82},"Software","software",114,"2026-10-08T17:57:01.000Z",{"name":84,"slug":85,"count":86,"latest_published_at":18},"Dev Tools","dev-tools",106,{"name":88,"slug":89,"count":90,"latest_published_at":91},"General","general",66,"2026-10-09T04:46:11.000Z",{"name":93,"slug":94,"count":95,"latest_published_at":96},"Gaming","gaming",58,"2026-10-08T20:08:45.000Z",{"name":98,"slug":99,"count":100,"latest_published_at":101},"Reviews","reviews",34,"2026-10-08T14:00:22.000Z",{"name":103,"slug":104,"count":105,"latest_published_at":106},"How-To","how-to",8,"2026-10-05T09:00:00.000Z"]