[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-ai-models-dont-reject-wrong-answers-the-way-we-thought":10,"sections":40},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":35,"feedback":39,"feedback_at":22,"cost_usd":39,"total_tokens":39},4198,"ai-models-dont-reject-wrong-answers-the-way-we-thought","AI Models Don't Reject Wrong Answers the Way We Thought","A study of seven transformer models finds that what looks like rejecting a wrong answer may be the model simply conforming to a forced incorrect token.","Researchers set out to prove that transformer models can internally 'reject' wrong answers. The geometry says something murkier.\n\nThe study forced seven decoder-only transformer models to process both the correct and incorrect single-token completions of factual questions. The hidden-state vectors for the two paths stayed close in magnitude but rotated apart as information moved through mid-depth layers, before late layers produced a lopsided result. That lopsidedness cuts against the 'rejection' story: in the incorrect run, the logit lens showed roughly 11.5 times more probability mass on the wrong token than the right one, meaning the model was heavily loaded toward the bad answer, not away from it. The pattern held across six architectures (Llama, Mistral, Gemma, and StableLM) spanning 1B to 13B parameters; Qwen2 1.5B was flat under the same protocol, possibly a tokenizer artifact.\n\nWhether the late-layer asymmetry reflects genuine internal rejection or the model simply conforming to the token it was forced to carry is a question the study cannot resolve. The researchers note only a random-token control can settle it, and that control was not run. That gap matters: the mechanistic interpretability field has staked a lot on the idea that internal representations track truth, not just surface token statistics.\n\nActivation patching, run on a subset of the models, found no single layer responsible for the asymmetry, fitting a distributed-across-layers account rather than a clean circuit. The field has been hoping for neater module boundaries inside large transformers. It is not finding them.","[\"ai\",\"transformers\",\"research\",\"interpretability\"]","2026-07-07T04:00:00.000Z","2026-07-07T19:37:12.389Z","2026-07-07T19:37:15.170Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"The article misrepresents the logit-lens figure: the source says the incorrect run has 11.5x more mass on the incorrect token than the correct one (i.e., the model is biased toward the wrong answer, not 'rejecting' it), but the article describes this as 'logit-lens preference for the wrong token was roughly 11.5 times higher than the equal-probability baseline' — a subtly different framing that obscures the direction of the effect and muddies the central claim about rejection versus conformity.","resolved","ai",[30,32,33,34],"transformers","research","interpretability",[36],{"name":37,"url":38},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2603.13259",0,{"sections":41},[42,46,51,56,61,66,71,76,81,85,90,94,99,104],{"name":43,"slug":30,"count":44,"latest_published_at":45},"AI",2590,"2026-07-16T04:00:00.000Z",{"name":47,"slug":48,"count":49,"latest_published_at":50},"Security","security",294,"2026-07-15T19:59:48.000Z",{"name":52,"slug":53,"count":54,"latest_published_at":55},"Deals","deals",179,"2026-06-29T20:02:07.000Z",{"name":57,"slug":58,"count":59,"latest_published_at":60},"Policy","policy",158,"2026-07-16T00:02:48.000Z",{"name":62,"slug":63,"count":64,"latest_published_at":65},"Hardware","hardware",122,"2026-07-14T19:46:26.000Z",{"name":67,"slug":68,"count":69,"latest_published_at":70},"Consumer Tech","consumer-tech",93,"2026-07-13T13:20:48.000Z",{"name":72,"slug":73,"count":74,"latest_published_at":75},"Software","software",70,"2026-07-13T19:52:25.000Z",{"name":77,"slug":78,"count":79,"latest_published_at":80},"Science","science",66,"2026-07-10T10:29:37.000Z",{"name":82,"slug":83,"count":84,"latest_published_at":18},"Dev Tools","dev-tools",59,{"name":86,"slug":87,"count":88,"latest_published_at":89},"Gaming","gaming",41,"2026-07-09T04:00:00.000Z",{"name":91,"slug":92,"count":88,"latest_published_at":93},"Startups","startups","2026-06-29T20:55:50.000Z",{"name":95,"slug":96,"count":97,"latest_published_at":98},"General","general",29,"2026-07-10T22:28:58.000Z",{"name":100,"slug":101,"count":102,"latest_published_at":103},"Reviews","reviews",20,"2026-06-24T12:00:01.000Z",{"name":105,"slug":106,"count":107,"latest_published_at":108},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]