[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-researchers-tame-error-drift-in-ai-agent-training-method":10,"sections":41},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":30,"persona_id":30,"persona_name":30,"section":31,"tags":32,"sources":36,"feedback":40,"feedback_at":30,"cost_usd":40,"total_tokens":40},10964,"researchers-tame-error-drift-in-ai-agent-training-method","Researchers Tame Error Drift in AI Agent Training Method","A new method lets a teacher AI model randomly decide, based on how far a student has drifted, whether to step in and fix its next move.","A new training technique stops small AI agents from spiraling into compounding errors when they are trained by a bigger model.\n\nOn-policy distillation trains a smaller student language model by having a stronger teacher model grade the student's own generated responses token by token, and it has worked well on tasks like math problems. Multi-turn agentic tasks are harder: each action a student takes changes what it sees next, so an early mistake snowballs and the student's trajectory can end up far from anything the teacher would produce. Once that happens, the teacher's feedback stops being useful and can even make training worse. The new method, called STI-OPD, has the teacher step in and replace the student's proposed action with its own, triggered by a stochastic process that measures the policy gap with KL divergence, turns it into a probability, and randomly samples whether to intervene rather than acting only past a fixed threshold or on a preset schedule; a companion Importance-Weighted Reverse KL objective then corrects for the mismatch between teacher-written and student-generated text so the training signal stays accurate.\n\nThis targets a real bottleneck in how agentic AI gets built right now: as labs train models to use tools, browse the web, or carry out long multi-step tasks, the gap between a rollout and a teacher's intended path grows with every turn, and naive distillation methods either over-correct or ignore the drift entirely. STI-OPD's results back up the fix: it beat the strongest prior on-policy distillation baseline on every benchmark and student model size the researchers tested, covering both tool-use reasoning and long-horizon interaction tasks.\n\nIt is a plumbing-level improvement, not a new capability, but plumbing like this is what decides whether an AI agent trained on a teacher's examples can actually hold up over twenty steps instead of just the first two.","[\"ai\",\"agentic ai\",\"distillation\",\"llm training\"]","2026-10-09T04:00:00.000Z","2026-10-09T23:43:16.452Z","2026-10-17T21:36:23.071Z","published","Duplicate of \"New method teaches AI agents when to self-correct\"",[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"The description of the mechanism is backwards: the source explicitly says STI-OPD replaces threshold-based intervention with a stochastic\u002Fprobabilistic one (KL divergence maps to an intervention probability, and whether to intervene is sampled from that probability), but the dek and body describe it as intervening only when a 'probability threshold' is crossed 'rather than a fixed rule' — rewrite this explanation to match the source's actual stochastic-sampling mechanism.","resolved",null,"ai",[31,33,34,35],"agentic ai","distillation","llm training",[37],{"name":38,"url":39},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2610.10878",0,{"sections":42},[43,47,52,57,62,67,72,77,82,87,92,97,102,107],{"name":44,"slug":31,"count":45,"latest_published_at":46},"AI",7038,"2026-10-17T19:58:31.000Z",{"name":48,"slug":49,"count":50,"latest_published_at":51},"Security","security",1001,"2026-10-17T22:20:00.000Z",{"name":53,"slug":54,"count":55,"latest_published_at":56},"Policy","policy",538,"2026-10-17T19:38:12.000Z",{"name":58,"slug":59,"count":60,"latest_published_at":61},"Deals","deals",521,"2026-10-17T07:00:00.000Z",{"name":63,"slug":64,"count":65,"latest_published_at":66},"Hardware","hardware",260,"2026-10-17T19:55:36.000Z",{"name":68,"slug":69,"count":70,"latest_published_at":71},"Consumer Tech","consumer-tech",235,"2026-10-16T23:36:26.000Z",{"name":73,"slug":74,"count":75,"latest_published_at":76},"Science","science",202,"2026-10-16T11:00:53.000Z",{"name":78,"slug":79,"count":80,"latest_published_at":81},"Startups","startups",133,"2026-10-14T19:51:34.000Z",{"name":83,"slug":84,"count":85,"latest_published_at":86},"Software","software",128,"2026-10-14T22:23:48.000Z",{"name":88,"slug":89,"count":90,"latest_published_at":91},"Dev Tools","dev-tools",116,"2026-10-13T16:20:18.000Z",{"name":93,"slug":94,"count":95,"latest_published_at":96},"General","general",81,"2026-10-16T16:06:38.000Z",{"name":98,"slug":99,"count":100,"latest_published_at":101},"Gaming","gaming",77,"2026-10-17T16:59:39.000Z",{"name":103,"slug":104,"count":105,"latest_published_at":106},"Reviews","reviews",37,"2026-10-14T10:00:00.000Z",{"name":108,"slug":109,"count":110,"latest_published_at":111},"How-To","how-to",8,"2026-10-05T09:00:00.000Z"]