[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-new-study-says-ai-truth-probes-may-not-reflect-behavior":10,"sections":41},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":36,"feedback":40,"feedback_at":22,"cost_usd":40,"total_tokens":40},6508,"new-study-says-ai-truth-probes-may-not-reflect-behavior","New Study Says AI Truth Probes May Not Reflect Behavior","A new arXiv study finds AI truth probes often track the wrong signal, flipping model behavior far less than the features that actually matter.","A new study shows that the interpretability probes AI labs use to catch models lying may be reading the wrong signal entirely.\n\nIn a preprint posted to arXiv on September 17 titled \"Decodability is Not Causality,\" researchers built a diagnostic that breaks a deployed truth\u002Fdeception probe down into individual sparse-autoencoder features, then ranks each one by two criteria: how closely it aligns with the probe's geometry, and how much it actually moves model behavior when ablated. Testing the TTPD truth probe from Buerger et al. (2024), applied to Gemma2-9B-Instruct under the instructed truth\u002Fdeception setup from Long et al. (2025), the two rankings barely agreed - about 12% overlap, with a Spearman correlation of just 0.10. When the team ablated features, the ones the probe actually shared with the model's real behavior flipped outputs up to 27% of the time, versus 6% for features that only looked important to the probe geometrically, and 1% for random features.\n\nThat gap held up across five random seeds and a held-out data split, which rules out a fluke. Combining probe direction with activation statistics recovered far more of the causally relevant features - a 17.6% flip rate versus 6.1% for the probe's raw top-ranked features - suggesting today's simpler probing methods can give safety teams a false sense of precision.\n\nIf a lie-detector for language models can't tell you which wires it's actually reading, it's worth asking how many other interpretability results are measuring the map instead of the territory.","[\"ai-safety\",\"interpretability\",\"sparse-autoencoders\",\"llm-research\"]","2026-09-17T04:00:00.000Z","2026-09-17T21:29:50.163Z","2026-09-17T21:30:02.073Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"Attribute the finding to its actual source (e.g. the arXiv preprint 'Decodability is Not Causality' and\u002For authors Buerger et al.\u002FLong et al.) instead of leaving it as unnamed 'researchers' with no publication or link given.","resolved","ai",[32,33,34,35],"ai-safety","interpretability","sparse-autoencoders","llm-research",[37],{"name":38,"url":39},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2609.18080",0,{"sections":42},[43,47,51,56,61,65,69,74,79,83,88,93,98,103],{"name":44,"slug":30,"count":45,"latest_published_at":46},"AI",3852,"2026-09-17T08:27:09.000Z",{"name":48,"slug":49,"count":50,"latest_published_at":18},"Security","security",648,{"name":52,"slug":53,"count":54,"latest_published_at":55},"Policy","policy",338,"2026-09-11T04:00:00.000Z",{"name":57,"slug":58,"count":59,"latest_published_at":60},"Deals","deals",179,"2026-06-29T20:02:07.000Z",{"name":62,"slug":63,"count":64,"latest_published_at":18},"Hardware","hardware",154,{"name":66,"slug":67,"count":68,"latest_published_at":18},"Science","science",114,{"name":70,"slug":71,"count":72,"latest_published_at":73},"Consumer Tech","consumer-tech",99,"2026-09-09T17:27:33.000Z",{"name":75,"slug":76,"count":77,"latest_published_at":78},"Software","software",75,"2026-09-10T20:41:21.000Z",{"name":80,"slug":81,"count":82,"latest_published_at":18},"Dev Tools","dev-tools",73,{"name":84,"slug":85,"count":86,"latest_published_at":87},"Startups","startups",55,"2026-09-09T23:14:29.000Z",{"name":89,"slug":90,"count":91,"latest_published_at":92},"Gaming","gaming",43,"2026-09-10T12:18:06.000Z",{"name":94,"slug":95,"count":96,"latest_published_at":97},"General","general",41,"2026-09-08T01:57:23.000Z",{"name":99,"slug":100,"count":101,"latest_published_at":102},"Reviews","reviews",20,"2026-06-24T12:00:01.000Z",{"name":104,"slug":105,"count":106,"latest_published_at":107},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]