[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-new-method-prices-in-ai-judge-bias-does-not-erase-it":10,"sections":41},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":36,"feedback":40,"feedback_at":22,"cost_usd":40,"total_tokens":40},9412,"new-method-prices-in-ai-judge-bias-does-not-erase-it","New Method Prices In AI Judge Bias, Does Not Erase It","A new technique accounts for bias in AI judges used to train chatbots on human preferences, but admits the bias itself is never removed.","Researchers have built a way to account for bias in the AI judges that now help train chatbots, though they admit the bias itself doesn't go away.\n\nTraining large language models on human preferences normally means paying people to compare pairs of responses, which is slow and expensive. To cut costs, researchers have started supplementing that process with AI judges, whose feedback is fed into active learning systems that pick the most informative comparisons to study. The problem is that AI judges don't always agree with the human population a model is meant to serve, and that mismatch can get worse once the system starts actively selecting which comparisons to use. The paper proposes Nuisance-Adjusted Optimal Design, a selection method built on the Frank-Wolfe optimization algorithm, and tests it on Chatbot Arena data across 17 judges and 15 budget configurations.\n\nThe method doesn't erase judge bias. It adjusts for it mathematically so the bias doesn't masquerade as useful signal, and the paper shows that ignoring this distinction can reverse the usual advantage of smarter comparison selection. In testing, the adjusted approach cut a benchmark regret measure by 29.1% and improved predictions of real human preferences on new data.\n\nIt's a reminder that using AI to grade AI doesn't remove the grading problem, it just moves it into the math.","[\"ai-alignment\",\"llm-judges\",\"chatbot-arena\",\"bias\"]","2026-10-01T04:00:00.000Z","2026-10-02T16:52:14.821Z","2026-10-02T16:52:20.596Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"The headline claims researchers 'Find a Fix' for biased AI judges, but the body explicitly states the method 'does not erase the bias problem' and only prices it in more honestly — rewrite the headline\u002Fdek to match that more modest, accurate framing.","resolved","ai",[32,33,34,35],"ai-alignment","llm-judges","chatbot-arena","bias",[37],{"name":38,"url":39},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2609.38860",0,{"sections":42},[43,47,52,57,62,67,72,77,82,87,92,97,102,107],{"name":44,"slug":30,"count":45,"latest_published_at":46},"AI",5722,"2026-10-02T04:00:00.000Z",{"name":48,"slug":49,"count":50,"latest_published_at":51},"Security","security",829,"2026-10-01T17:31:56.000Z",{"name":53,"slug":54,"count":55,"latest_published_at":56},"Policy","policy",437,"2026-10-01T18:10:00.000Z",{"name":58,"slug":59,"count":60,"latest_published_at":61},"Deals","deals",317,"2026-10-01T22:00:00.000Z",{"name":63,"slug":64,"count":65,"latest_published_at":66},"Hardware","hardware",198,"2026-10-01T17:38:48.000Z",{"name":68,"slug":69,"count":70,"latest_published_at":71},"Science","science",168,"2026-10-01T18:35:55.000Z",{"name":73,"slug":74,"count":75,"latest_published_at":76},"Consumer Tech","consumer-tech",155,"2026-10-01T19:54:10.000Z",{"name":78,"slug":79,"count":80,"latest_published_at":81},"Dev Tools","dev-tools",96,"2026-10-01T16:57:03.000Z",{"name":83,"slug":84,"count":85,"latest_published_at":86},"Software","software",93,"2026-09-30T21:41:11.000Z",{"name":88,"slug":89,"count":90,"latest_published_at":91},"Startups","startups",90,"2026-10-01T21:55:22.000Z",{"name":93,"slug":94,"count":95,"latest_published_at":96},"Gaming","gaming",53,"2026-10-02T02:50:39.000Z",{"name":98,"slug":99,"count":100,"latest_published_at":101},"General","general",50,"2026-09-30T21:37:54.000Z",{"name":103,"slug":104,"count":105,"latest_published_at":106},"Reviews","reviews",31,"2026-09-28T14:31:34.000Z",{"name":108,"slug":109,"count":110,"latest_published_at":111},"How-To","how-to",7,"2026-10-01T09:00:00.000Z"]