[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-a-new-model-explains-when-more-ai-inference-hurts-accuracy":10,"sections":34},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":24,"tags":25,"sources":29,"feedback":33,"feedback_at":22,"cost_usd":33,"total_tokens":33},10098,"a-new-model-explains-when-more-ai-inference-hurts-accuracy","A New Model Explains When More AI Inference Hurts Accuracy","A tractable math model shows why more inference-time sampling helps AI judges only when their reward signal matches the task, and backfires when it doesn't.","A new paper finally explains the math behind why giving AI models more thinking time sometimes pays off and sometimes backfires.\n\nResearchers built an analytically solvable model of an LLM-as-a-judge setup, using Bayesian linear regression with a reward-weighted sampler, to study inference-time scaling - the practice of generating many candidate answers and picking the best one via a judge model instead of training a bigger one. They found that when the judge's reward signal is close to the true quality signal, pulling more samples steadily lowers error, decaying at a predictable 1\u002Fk-squared rate. But when the reward is badly misspecified, there's a finite number of samples beyond which more sampling makes results worse, and for any fixed sample count there's an optimal sampling temperature. They confirmed the pattern experimentally using an LLM as judge, and found the benefit of extra inference compute shrinks as tasks get harder.\n\nThat matters because companies are pouring inference budget into best-of-k sampling and judge-based reranking on the assumption that more samples always means better answers. This gives engineers an actual formula for when that bet pays off, and a warning for when it quietly stops working - which, inconveniently, is exactly on the hardest problems where teams lean hardest on extra compute.\n\nSo the industry's favorite inference-time scaling story comes with an asterisk, and the asterisk gets bigger exactly where it matters most.","[\"ai\",\"llm-as-a-judge\",\"inference-scaling\",\"research\"]","2026-10-05T04:00:00.000Z","2026-10-05T22:56:07.625Z","2026-10-05T22:56:14.395Z","published",null,[],"ai",[24,26,27,28],"llm-as-a-judge","inference-scaling","research",[30],{"name":31,"url":32},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2512.19905",0,{"sections":35},[36,40,44,49,54,59,63,68,73,78,83,88,93,98],{"name":37,"slug":24,"count":38,"latest_published_at":39},"AI",6317,"2026-10-05T09:51:57.000Z",{"name":41,"slug":42,"count":43,"latest_published_at":18},"Security","security",871,{"name":45,"slug":46,"count":47,"latest_published_at":48},"Policy","policy",446,"2026-10-05T10:25:00.000Z",{"name":50,"slug":51,"count":52,"latest_published_at":53},"Deals","deals",340,"2026-10-05T09:18:03.000Z",{"name":55,"slug":56,"count":57,"latest_published_at":58},"Hardware","hardware",205,"2026-10-05T10:58:22.000Z",{"name":60,"slug":61,"count":62,"latest_published_at":18},"Science","science",179,{"name":64,"slug":65,"count":66,"latest_published_at":67},"Consumer Tech","consumer-tech",160,"2026-10-05T10:23:15.000Z",{"name":69,"slug":70,"count":71,"latest_published_at":72},"Dev Tools","dev-tools",99,"2026-10-05T10:47:06.000Z",{"name":74,"slug":75,"count":76,"latest_published_at":77},"Software","software",97,"2026-10-04T10:00:00.000Z",{"name":79,"slug":80,"count":81,"latest_published_at":82},"Startups","startups",93,"2026-10-05T11:13:51.000Z",{"name":84,"slug":85,"count":86,"latest_published_at":87},"Gaming","gaming",53,"2026-10-02T02:50:39.000Z",{"name":89,"slug":90,"count":91,"latest_published_at":92},"General","general",51,"2026-10-05T02:35:01.000Z",{"name":94,"slug":95,"count":96,"latest_published_at":97},"Reviews","reviews",32,"2026-10-02T18:00:00.000Z",{"name":99,"slug":100,"count":101,"latest_published_at":102},"How-To","how-to",8,"2026-10-05T09:00:00.000Z"]