[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-calibrating-ai-judges-to-stop-bias-from-infecting-agents":10,"sections":34},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":24,"tags":25,"sources":29,"feedback":33,"feedback_at":22,"cost_usd":33,"total_tokens":33},3095,"calibrating-ai-judges-to-stop-bias-from-infecting-agents","Calibrating AI Judges to Stop Bias From Infecting Agents","A new study finds that probability calibration cuts evaluator bias propagation in LLM feedback loops by up to 49%, with a lightweight fix ready to deploy.","A small but pointed study argues that the way AI systems learn from AI feedback is systematically skewed — and that a calibration fix can substantially reduce the damage.\n\nWhen an LLM agent improves its behavior through feedback from an evaluator model, any biases in that evaluator quietly bake themselves into the agent's strategy over time. Researchers call this \"evaluator preference coupling.\" Prior work identified and measured the problem; this paper is the first to test whether probability calibration can actually fix it. Using DeepSeek-V4-Pro as the learning agent and GLM5.2 as the judge, the team ran a controlled experiment comparing standard binary training — simple win\u002Floss signals — against confidence-calibrated updates that weight outcomes by probability. Calibration reduced the coupling coefficient by 20-49% and cut Jensen-Shannon divergence by 45-67%.\n\nThe finding matters because LLM-as-judge pipelines are everywhere now. As labs increasingly use AI evaluators to train or steer other AI systems, bias compounding becomes a structural risk — one that can be hard to detect because the student model has no ground truth to push back against. A lightweight calibration step inserted into the feedback loop could prevent a class of alignment drift that would otherwise be invisible until it surfaces in behavior.\n\nThe experiment ran with only five subjects, which is a notable limitation the authors acknowledge. The calibrated TTRL protocol is public, but production teams should treat this as a promising early signal, not a solved problem.","[\"ai\",\"llm\",\"alignment\",\"research\"]","2026-07-01T04:00:00.000Z","2026-07-01T07:08:58.404Z","2026-07-01T07:09:01.226Z","published",null,[],"ai",[24,26,27,28],"llm","alignment","research",[30],{"name":31,"url":32},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2606.31371",0,{"sections":35},[36,40,45,50,55,60,65,70,75,80,85,89,94,99],{"name":37,"slug":24,"count":38,"latest_published_at":39},"AI",2590,"2026-07-16T04:00:00.000Z",{"name":41,"slug":42,"count":43,"latest_published_at":44},"Security","security",294,"2026-07-15T19:59:48.000Z",{"name":46,"slug":47,"count":48,"latest_published_at":49},"Deals","deals",179,"2026-06-29T20:02:07.000Z",{"name":51,"slug":52,"count":53,"latest_published_at":54},"Policy","policy",158,"2026-07-16T00:02:48.000Z",{"name":56,"slug":57,"count":58,"latest_published_at":59},"Hardware","hardware",122,"2026-07-14T19:46:26.000Z",{"name":61,"slug":62,"count":63,"latest_published_at":64},"Consumer Tech","consumer-tech",93,"2026-07-13T13:20:48.000Z",{"name":66,"slug":67,"count":68,"latest_published_at":69},"Software","software",70,"2026-07-13T19:52:25.000Z",{"name":71,"slug":72,"count":73,"latest_published_at":74},"Science","science",66,"2026-07-10T10:29:37.000Z",{"name":76,"slug":77,"count":78,"latest_published_at":79},"Dev Tools","dev-tools",59,"2026-07-07T04:00:00.000Z",{"name":81,"slug":82,"count":83,"latest_published_at":84},"Gaming","gaming",41,"2026-07-09T04:00:00.000Z",{"name":86,"slug":87,"count":83,"latest_published_at":88},"Startups","startups","2026-06-29T20:55:50.000Z",{"name":90,"slug":91,"count":92,"latest_published_at":93},"General","general",29,"2026-07-10T22:28:58.000Z",{"name":95,"slug":96,"count":97,"latest_published_at":98},"Reviews","reviews",20,"2026-06-24T12:00:01.000Z",{"name":100,"slug":101,"count":102,"latest_published_at":103},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]