[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-milo-lets-ai-agents-evolve-their-own-tool-harnesses":10,"sections":35},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":24,"tags":25,"sources":30,"feedback":34,"feedback_at":22,"cost_usd":34,"total_tokens":34},9006,"milo-lets-ai-agents-evolve-their-own-tool-harnesses","MILO Lets AI Agents Evolve Their Own Tool Harnesses","A new framework called MILO evolves both AI agent harnesses and the search process that finds them, beating hand-tuned baselines on three benchmarks.","Researchers built a system that automatically redesigns the software scaffolding around AI agents - and it beats every human-tuned version they tested.\n\nA new paper describes MILO (Meta-evolutionary Island Orchestration), a framework that evolves both an AI agent's \"harness\" - the code controlling how a model executes tasks and interacts with its environment - and the search strategy used to find better harnesses. It works through island-based lineage trees that treat rejected mutations as useful negative evidence, mutator agents that rewrite entire harnesses using global search history, and an orchestrator that reassigns mutators and revises the curriculum as search progresses. Tested on three benchmarks (Terminal-Bench 2.1, PaperBench, and DeepSWE) using both Opus 4.8 and the open-weight gpt-oss-120b, MILO-discovered harnesses beat eight existing harnesses and six prior search methods. On Terminal-Bench 2.1 it scored 86.1%, topping the official leaderboard's prior best of 83.8% while using 26% fewer tokens than the harness it started from.\n\nHarness design - prompts, tool definitions, retry logic, memory strategies - has become as big a performance lever as the underlying model, but tuning it by hand is slow and has to be redone every time a new model ships. Automating that search, and improving the search process itself rather than just the harness, points toward agent systems that retune themselves as models change instead of requiring a team to rerun benchmarks after every release.\n\nEarlier automated approaches mostly tweaked prompts or skills in isolation and plateaued fast; MILO's actual trick is treating the search strategy as something worth evolving too, not just the thing being searched.","[\"ai agents\",\"agentic ai\",\"llm benchmarks\",\"ai research\"]","2026-10-01T04:00:00.000Z","2026-10-01T15:22:30.967Z","2026-10-01T15:22:37.193Z","published",null,[],"ai",[26,27,28,29],"ai agents","agentic ai","llm benchmarks","ai research",[31],{"name":32,"url":33},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2609.38349",0,{"sections":36},[37,40,44,49,54,59,63,68,73,77,82,87,92,97],{"name":38,"slug":24,"count":39,"latest_published_at":18},"AI",5487,{"name":41,"slug":42,"count":43,"latest_published_at":18},"Security","security",809,{"name":45,"slug":46,"count":47,"latest_published_at":48},"Policy","policy",429,"2026-10-01T02:26:17.000Z",{"name":50,"slug":51,"count":52,"latest_published_at":53},"Deals","deals",298,"2026-09-30T21:00:26.000Z",{"name":55,"slug":56,"count":57,"latest_published_at":58},"Hardware","hardware",196,"2026-09-30T13:00:00.000Z",{"name":60,"slug":61,"count":62,"latest_published_at":18},"Science","science",162,{"name":64,"slug":65,"count":66,"latest_published_at":67},"Consumer Tech","consumer-tech",149,"2026-09-30T22:57:11.000Z",{"name":69,"slug":70,"count":71,"latest_published_at":72},"Dev Tools","dev-tools",93,"2026-10-01T02:30:48.000Z",{"name":74,"slug":75,"count":71,"latest_published_at":76},"Software","software","2026-09-30T21:41:11.000Z",{"name":78,"slug":79,"count":80,"latest_published_at":81},"Startups","startups",84,"2026-09-30T20:39:09.000Z",{"name":83,"slug":84,"count":85,"latest_published_at":86},"Gaming","gaming",51,"2026-09-30T16:24:30.000Z",{"name":88,"slug":89,"count":90,"latest_published_at":91},"General","general",50,"2026-09-30T21:37:54.000Z",{"name":93,"slug":94,"count":95,"latest_published_at":96},"Reviews","reviews",31,"2026-09-28T14:31:34.000Z",{"name":98,"slug":99,"count":100,"latest_published_at":101},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]