[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-drift-trains-llms-to-improve-themselves-more-efficiently":10,"sections":40},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":35,"feedback":39,"feedback_at":22,"cost_usd":39,"total_tokens":39},2780,"drift-trains-llms-to-improve-themselves-more-efficiently","DRIFT Trains LLMs to Improve Themselves More Efficiently","A new self-training framework routes problems by difficulty and beats two leading reinforcement learning methods across five benchmarks.","Researchers have published a framework that lets large language models train themselves more effectively by treating hard, easy, and borderline problems differently.\n\nCalled DRIFT, the system combines two mechanisms: Difficulty Routing, which classifies each training problem by how well the model is currently handling it and then decides whether to apply self-distillation or reinforcement learning signals, and Rhythm Gating, which focuses exploration on the specific token positions where reasoning is most likely to go wrong. A success buffer preserves high-quality past examples, and a two-stage curriculum moves the model from acquiring reliable behavior first before pushing toward stable policy evolution. Evaluated across five benchmarks at three different model scales, DRIFT hit an average score of 79.5%, beating GRPO by 9.5 percentage points and SDPO by 7.5 percentage points. On tool-use tasks specifically, it outpaced GRPO by 13.5 points and SDPO by 10.7 points.\n\nThe core problem DRIFT addresses is one the field has quietly struggled with: standard self-improvement loops tend to waste compute hammering easy problems while getting nearly useless signal from very hard ones, leaving the middle ground underexplored. A method that routes training signal based on per-problem learning state is a more principled approach than the flat sampling most current methods use.\n\nThe results are from an arXiv preprint, so independent replication is still ahead — but the margin over GRPO, itself a well-regarded baseline, is large enough that this is worth watching before the next training run budget gets locked in.","[\"ai\",\"machine-learning\",\"llm\",\"research\"]","2026-06-30T04:00:00.000Z","2026-06-30T12:36:17.147Z","2026-06-30T12:36:19.919Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"The article states GRPO scored 70.0% and SDPO scored 72.0%, but those figures cannot be confirmed from the source — the source only states DRIFT outperformed GRPO by 9.5 percentage points and SDPO by 7.5 percentage points; the absolute baseline scores are not provided in the source material and appear to be back-calculated or invented, which violates the rule against unsourced numerical claims.","resolved","ai",[30,32,33,34],"machine-learning","llm","research",[36],{"name":37,"url":38},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2606.30345",0,{"sections":41},[42,46,51,56,61,66,71,76,81,86,91,95,100,105],{"name":43,"slug":30,"count":44,"latest_published_at":45},"AI",2590,"2026-07-16T04:00:00.000Z",{"name":47,"slug":48,"count":49,"latest_published_at":50},"Security","security",294,"2026-07-15T19:59:48.000Z",{"name":52,"slug":53,"count":54,"latest_published_at":55},"Deals","deals",179,"2026-06-29T20:02:07.000Z",{"name":57,"slug":58,"count":59,"latest_published_at":60},"Policy","policy",158,"2026-07-16T00:02:48.000Z",{"name":62,"slug":63,"count":64,"latest_published_at":65},"Hardware","hardware",122,"2026-07-14T19:46:26.000Z",{"name":67,"slug":68,"count":69,"latest_published_at":70},"Consumer Tech","consumer-tech",93,"2026-07-13T13:20:48.000Z",{"name":72,"slug":73,"count":74,"latest_published_at":75},"Software","software",70,"2026-07-13T19:52:25.000Z",{"name":77,"slug":78,"count":79,"latest_published_at":80},"Science","science",66,"2026-07-10T10:29:37.000Z",{"name":82,"slug":83,"count":84,"latest_published_at":85},"Dev Tools","dev-tools",59,"2026-07-07T04:00:00.000Z",{"name":87,"slug":88,"count":89,"latest_published_at":90},"Gaming","gaming",41,"2026-07-09T04:00:00.000Z",{"name":92,"slug":93,"count":89,"latest_published_at":94},"Startups","startups","2026-06-29T20:55:50.000Z",{"name":96,"slug":97,"count":98,"latest_published_at":99},"General","general",29,"2026-07-10T22:28:58.000Z",{"name":101,"slug":102,"count":103,"latest_published_at":104},"Reviews","reviews",20,"2026-06-24T12:00:01.000Z",{"name":106,"slug":107,"count":108,"latest_published_at":109},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]