[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-auto-compiles-llm-agent-runs-into-cheap-verified-programs":10,"sections":41},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":36,"feedback":40,"feedback_at":22,"cost_usd":40,"total_tokens":40},3961,"auto-compiles-llm-agent-runs-into-cheap-verified-programs","Auto Compiles LLM Agent Runs Into Cheap, Verified Programs","A new arXiv paper describes Auto, a compiler that cuts LLM agent costs 6.4x end-to-end, and quantifies exactly how it fails silently when calibration slips.","A paper posted to arXiv proposes treating LLM agent behavior like compilable source code, so the predictable parts never have to hit a frontier model twice.\n\nResearchers at RightNow AI built a system called Auto that watches a frontier model agent work, identifies which steps always produce the same output, and packages those as cognition binaries: WebAssembly artifacts whose manifests carry measured guarantees and whose declared capabilities are enforced by a sandbox. When a compiled binary encounters an unfamiliar input, it falls back to the full model, captures the new trace, and recompiles. On AUTO-BENCH, a benchmark the team introduces and pre-registers in the arXiv paper, 87.1% of 560 recorded frontier-agent spans are witnessed-deterministic (three of the four task families hit 100.0%); on a 300-item stream with three scheduled distribution shifts, Auto cut marginal cost from 59 to 2 micro-dollars per item, a 6.4x reduction end-to-end, at 96.9% parity on witnessed inputs. Code is on [GitHub](https:\u002F\u002Fgithub.com\u002FRightNow-AI\u002Fauto).\n\nThe paper's most useful contribution may be the failure taxonomy. A loose guard silently mislabeled 48.9% of compiled answers: costs drop, wrong answers go out, and nothing alerts you. The authors conclude that calibration and reference fidelity, not model capability, decide whether cheaper also means correct.\n\nFor repetitive, high-volume workloads the cost reduction is real on paper; the 48.9% silent failure rate is the figure that will determine whether it stays real in production.","[\"llm-agents\",\"inference-cost\",\"webassembly\",\"ai-research\"]","2026-07-07T04:00:00.000Z","2026-07-07T13:27:30.163Z","2026-07-07T13:27:32.968Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"The dek states '6.4x reduction' in the text but the headline uses 'cheap, verified' without the figure — acceptable — however the body describes the 6.4x as a cost reduction when the source states '6.4x end-to-end,' which is consistent, but the body omits that 87.1% of recorded spans are witnessed-deterministic (a key finding that would strengthen the analysis), and more critically the draft never attributes the benchmark figures to a named source (the arXiv paper) or links the GitHub repository","resolved","ai",[32,33,34,35],"llm-agents","inference-cost","webassembly","ai-research",[37],{"name":38,"url":39},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2607.04542",0,{"sections":42},[43,47,52,57,62,67,72,77,82,86,91,95,100,105],{"name":44,"slug":30,"count":45,"latest_published_at":46},"AI",2590,"2026-07-16T04:00:00.000Z",{"name":48,"slug":49,"count":50,"latest_published_at":51},"Security","security",294,"2026-07-15T19:59:48.000Z",{"name":53,"slug":54,"count":55,"latest_published_at":56},"Deals","deals",179,"2026-06-29T20:02:07.000Z",{"name":58,"slug":59,"count":60,"latest_published_at":61},"Policy","policy",158,"2026-07-16T00:02:48.000Z",{"name":63,"slug":64,"count":65,"latest_published_at":66},"Hardware","hardware",122,"2026-07-14T19:46:26.000Z",{"name":68,"slug":69,"count":70,"latest_published_at":71},"Consumer Tech","consumer-tech",93,"2026-07-13T13:20:48.000Z",{"name":73,"slug":74,"count":75,"latest_published_at":76},"Software","software",70,"2026-07-13T19:52:25.000Z",{"name":78,"slug":79,"count":80,"latest_published_at":81},"Science","science",66,"2026-07-10T10:29:37.000Z",{"name":83,"slug":84,"count":85,"latest_published_at":18},"Dev Tools","dev-tools",59,{"name":87,"slug":88,"count":89,"latest_published_at":90},"Gaming","gaming",41,"2026-07-09T04:00:00.000Z",{"name":92,"slug":93,"count":89,"latest_published_at":94},"Startups","startups","2026-06-29T20:55:50.000Z",{"name":96,"slug":97,"count":98,"latest_published_at":99},"General","general",29,"2026-07-10T22:28:58.000Z",{"name":101,"slug":102,"count":103,"latest_published_at":104},"Reviews","reviews",20,"2026-06-24T12:00:01.000Z",{"name":106,"slug":107,"count":108,"latest_published_at":109},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]