[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-coding-agents-struggle-to-find-bugs-without-issue-reports":10,"sections":40},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":35,"feedback":39,"feedback_at":22,"cost_usd":39,"total_tokens":39},8723,"coding-agents-struggle-to-find-bugs-without-issue-reports","Coding Agents Struggle to Find Bugs Without Issue Reports","A new benchmark from arXiv paper 2608.04682, Active-SWE, tests whether AI coding agents can find and fix bugs without an issue report and most fail.","A new benchmark says today's AI coding agents are lost without a bug report to guide them.\n\nThe benchmark, called Active-SWE, comes from a paper posted to arXiv (arXiv:2608.04682) that flips the usual test for coding agents. Most existing benchmarks hand an agent a detailed issue report and ask it to patch the specific bug described. Active-SWE instead asks agents to find bugs on their own, using 1,663 tasks spanning six bug categories and eight programming languages. The researchers built a difficulty-aware task pipeline and a dual-track evaluation framework to grade bug discovery and bug fixing separately.\n\nReal engineers rarely get a tidy issue report before they start debugging; they scan a codebase, spot something off, and fix it before it becomes a ticket. Active-SWE tests that proactive skill directly, and the results are unflattering: state-of-the-art coding agents struggled to locate and resolve even recorded bugs, let alone find new multi-bug problems or flag valid potential bugs on their own.\n\nIn other words, the agents billed as ready to replace junior engineers still need someone to write the bug report for them first.","[\"ai\",\"coding-agents\",\"benchmarks\",\"software-engineering\"]","2026-09-30T04:00:00.000Z","2026-09-30T21:53:24.362Z","2026-09-30T21:53:29.703Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"Attribute the benchmark to its actual source — name the arXiv paper (e.g. arXiv:2608.04682) and\u002For the researchers' institution instead of the vague 'Researchers built Active-SWE,' so readers can verify the claims.","resolved","ai",[30,32,33,34],"coding-agents","benchmarks","software-engineering",[36],{"name":37,"url":38},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2608.04682",0,{"sections":41},[42,46,51,56,61,65,69,73,78,82,87,92,97,102],{"name":43,"slug":30,"count":44,"latest_published_at":45},"AI",5214,"2026-09-30T13:00:00.000Z",{"name":47,"slug":48,"count":49,"latest_published_at":50},"Security","security",793,"2026-09-30T12:55:00.000Z",{"name":52,"slug":53,"count":54,"latest_published_at":55},"Policy","policy",419,"2026-09-30T12:24:32.000Z",{"name":57,"slug":58,"count":59,"latest_published_at":60},"Deals","deals",291,"2026-09-30T10:38:22.000Z",{"name":62,"slug":63,"count":64,"latest_published_at":45},"Hardware","hardware",196,{"name":66,"slug":67,"count":68,"latest_published_at":18},"Science","science",155,{"name":70,"slug":71,"count":72,"latest_published_at":45},"Consumer Tech","consumer-tech",144,{"name":74,"slug":75,"count":76,"latest_published_at":77},"Dev Tools","dev-tools",91,"2026-09-30T12:58:00.000Z",{"name":79,"slug":80,"count":76,"latest_published_at":81},"Software","software","2026-09-25T20:55:00.000Z",{"name":83,"slug":84,"count":85,"latest_published_at":86},"Startups","startups",83,"2026-09-29T21:51:36.000Z",{"name":88,"slug":89,"count":90,"latest_published_at":91},"General","general",49,"2026-09-28T16:44:57.000Z",{"name":93,"slug":94,"count":95,"latest_published_at":96},"Gaming","gaming",48,"2026-09-25T18:35:21.000Z",{"name":98,"slug":99,"count":100,"latest_published_at":101},"Reviews","reviews",31,"2026-09-28T14:31:34.000Z",{"name":103,"slug":104,"count":105,"latest_published_at":106},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]