[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-safety-training-via-distillation-can-smuggle-in-backdoors":10,"sections":35},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":24,"tags":25,"sources":30,"feedback":34,"feedback_at":22,"cost_usd":34,"total_tokens":34},10652,"safety-training-via-distillation-can-smuggle-in-backdoors","Safety Training Via Distillation Can Smuggle In Backdoors","Researchers show a poisoned teacher model can pass hidden backdoors to a safety-trained student with as few as 3 percent poisoned examples.","A new study shows that 'safety training' for AI models can carry a nasty side effect: a hidden backdoor transplanted straight into the student.\n\nResearchers tested on-policy distillation, a technique where a smaller 'student' model is trained to mimic a larger 'teacher' model, including techniques meant to make the student safer. They found that if the teacher is secretly backdoored, that malicious behavior transfers to the student even though the student started out clean. Poisoning just 3% of training data produced an attack success rate of up to 70% on the distilled student. With only 10 poisoned samples and 16 training epochs, the attack success rate still hit 67%, and a common distillation method called top-k KL spread the backdoor faster than the alternative sampled-token KL approach.\n\nSafety distillation has been pitched as a cheap way to pass good behavior down to smaller models, but it quietly assumes the teacher and its training data can be trusted. This research shows that assumption breaks easily and cheaply, which matters for any team importing a third-party teacher model or training pipeline without auditing it line by line.\n\nThe researchers' proposed fix, Lazy Defense, only slows the backdoor's spread rather than stopping it, which is a modest patch for what sounds like a structural problem.","[\"ai safety\",\"backdoor attacks\",\"model distillation\",\"llm security\"]","2026-10-07T04:00:00.000Z","2026-10-09T01:28:42.274Z","2026-10-09T01:28:46.350Z","published",null,[],"ai",[26,27,28,29],"ai safety","backdoor attacks","model distillation","llm security",[31],{"name":32,"url":33},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2610.07654",0,{"sections":36},[37,41,46,51,56,61,65,70,75,79,84,89,94,99],{"name":38,"slug":24,"count":39,"latest_published_at":40},"AI",6506,"2026-10-07T18:45:00.000Z",{"name":42,"slug":43,"count":44,"latest_published_at":45},"Security","security",911,"2026-10-07T19:53:42.000Z",{"name":47,"slug":48,"count":49,"latest_published_at":50},"Policy","policy",474,"2026-10-07T18:23:21.000Z",{"name":52,"slug":53,"count":54,"latest_published_at":55},"Deals","deals",453,"2026-10-07T23:58:31.000Z",{"name":57,"slug":58,"count":59,"latest_published_at":60},"Hardware","hardware",222,"2026-10-07T21:19:54.000Z",{"name":62,"slug":63,"count":64,"latest_published_at":18},"Science","science",187,{"name":66,"slug":67,"count":68,"latest_published_at":69},"Consumer Tech","consumer-tech",174,"2026-10-07T17:41:41.000Z",{"name":71,"slug":72,"count":73,"latest_published_at":74},"Software","software",113,"2026-10-07T18:10:00.000Z",{"name":76,"slug":77,"count":73,"latest_published_at":78},"Startups","startups","2026-10-07T23:36:57.000Z",{"name":80,"slug":81,"count":82,"latest_published_at":83},"Dev Tools","dev-tools",105,"2026-10-07T16:59:11.000Z",{"name":85,"slug":86,"count":87,"latest_published_at":88},"General","general",61,"2026-10-07T22:00:24.000Z",{"name":90,"slug":91,"count":92,"latest_published_at":93},"Gaming","gaming",56,"2026-10-07T12:00:00.000Z",{"name":95,"slug":96,"count":97,"latest_published_at":98},"Reviews","reviews",33,"2026-10-05T11:57:17.000Z",{"name":100,"slug":101,"count":102,"latest_published_at":103},"How-To","how-to",8,"2026-10-05T09:00:00.000Z"]