[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-new-method-makes-ai-training-more-resistant-to-bad-labels":10,"sections":35},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":24,"tags":25,"sources":30,"feedback":34,"feedback_at":22,"cost_usd":34,"total_tokens":34},6953,"new-method-makes-ai-training-more-resistant-to-bad-labels","New Method Makes AI Training More Resistant to Bad Labels","Researchers show self-supervised pre-training on unlabeled data makes models far more resistant to noisy labels, no clean subset required.","A new paper describes a way to make AI models shrug off messy training labels, without needing a clean dataset to start from.\n\nThe trick is sequencing, not new architecture. Researchers first pre-train a feature extractor on the target dataset using self-supervised learning (SSL), which needs no labels at all. Only then do they run standard supervised training on the same dataset, noisy labels and all. Tested across both contrastive and non-contrastive SSL methods, on datasets with synthetic and real-world label noise, and across multiple model architectures, the approach consistently beat training from scratch on both classification accuracy and the model's ability to flag mislabeled examples. The advantage grew as label noise got worse.\n\nThis matters because most noise-robust training methods assume you already have a small clean labeled subset to anchor on. In practice, that clean subset is often the hard part; real-world data from crowdsourcing, web scraping, or sensor logs rarely comes with a trustworthy label a person actually checked. Removing that requirement makes the method usable on the messy data teams actually have, not the tidy benchmarks papers are built on.\n\nThe results are notable but not shocking: the pre-trained models matched ImageNet and DinoV2 checkpoints at low noise levels and pulled ahead only once noise got severe. It's a solid engineering win, not a paradigm shift, and it's still an arXiv preprint rather than peer-reviewed work. Cleaning your data is still cheaper than needing this trick in the first place.","[\"machine learning\",\"self-supervised learning\",\"label noise\",\"ai research\"]","2026-09-18T04:00:00.000Z","2026-09-19T00:17:13.738Z","2026-09-19T00:17:25.580Z","published",null,[],"ai",[26,27,28,29],"machine learning","self-supervised learning","label noise","ai research",[31],{"name":32,"url":33},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2511.20844",0,{"sections":36},[37,40,44,49,54,58,62,67,71,76,81,86,91,96],{"name":38,"slug":24,"count":39,"latest_published_at":18},"AI",4082,{"name":41,"slug":42,"count":43,"latest_published_at":18},"Security","security",661,{"name":45,"slug":46,"count":47,"latest_published_at":48},"Policy","policy",339,"2026-09-17T12:00:00.000Z",{"name":50,"slug":51,"count":52,"latest_published_at":53},"Deals","deals",179,"2026-06-29T20:02:07.000Z",{"name":55,"slug":56,"count":57,"latest_published_at":18},"Hardware","hardware",155,{"name":59,"slug":60,"count":61,"latest_published_at":18},"Science","science",125,{"name":63,"slug":64,"count":65,"latest_published_at":66},"Consumer Tech","consumer-tech",99,"2026-09-09T17:27:33.000Z",{"name":68,"slug":69,"count":70,"latest_published_at":18},"Dev Tools","dev-tools",78,{"name":72,"slug":73,"count":74,"latest_published_at":75},"Software","software",75,"2026-09-10T20:41:21.000Z",{"name":77,"slug":78,"count":79,"latest_published_at":80},"Startups","startups",55,"2026-09-09T23:14:29.000Z",{"name":82,"slug":83,"count":84,"latest_published_at":85},"Gaming","gaming",43,"2026-09-10T12:18:06.000Z",{"name":87,"slug":88,"count":89,"latest_published_at":90},"General","general",41,"2026-09-08T01:57:23.000Z",{"name":92,"slug":93,"count":94,"latest_published_at":95},"Reviews","reviews",20,"2026-06-24T12:00:01.000Z",{"name":97,"slug":98,"count":99,"latest_published_at":100},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]