[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-llms-know-cbt-theory-but-fail-to-apply-it-in-practice":10,"sections":34},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":24,"tags":25,"sources":29,"feedback":33,"feedback_at":22,"cost_usd":33,"total_tokens":33},3773,"llms-know-cbt-theory-but-fail-to-apply-it-in-practice","LLMs Know CBT Theory but Fail to Apply It in Practice","A new study finds that large language models default to validation and reflection in therapy contexts, even when given structured CBT frameworks to follow.","LLMs trained on clinical knowledge still can't do clinical reasoning when it counts.\n\nResearchers tested whether feeding large language models a structured Cognitive Behavioral Therapy framework would change how those models actually respond to users in distress. It didn't, not really. The models scored as high as 96% on CBT licensing exam questions — demonstrating solid theoretical knowledge — but when deployed in dialogue, they collapsed into a single mode: validate the user, reflect their feelings back, repeat. The team introduced a metric called Protocol Leverage Force to measure how far a structured prompt can push a model away from its default behavior. Across three open-weight models and 14 clinical case studies, even the best intervention shifted behavior by roughly 1.2 to 1.3 percentage points.\n\nThe gap matters because the mental health AI space is crowded with products leaning on exactly this assumption — that an LLM briefed on therapy frameworks will behave like a therapist. This paper gives researchers a concrete instrument to test that claim and, so far, the claim fails. Knowing what Socratic Questioning is and choosing to use it in the right moment are two very different skills.\n\nThe findings echo a broader pattern in applied AI: benchmark performance and real-world behavior routinely diverge. A model that aces a licensing exam is a model optimized for the format of licensing exams, not for the messy, context-dependent work those licenses are supposed to certify.","[\"ai\",\"mental health\",\"large language models\",\"research\"]","2026-07-07T04:00:00.000Z","2026-07-07T08:12:06.077Z","2026-07-07T08:12:09.078Z","published",null,[],"ai",[24,26,27,28],"mental health","large language models","research",[30],{"name":31,"url":32},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2607.02885",0,{"sections":35},[36,40,45,50,55,60,65,70,75,79,84,88,93,98],{"name":37,"slug":24,"count":38,"latest_published_at":39},"AI",2590,"2026-07-16T04:00:00.000Z",{"name":41,"slug":42,"count":43,"latest_published_at":44},"Security","security",294,"2026-07-15T19:59:48.000Z",{"name":46,"slug":47,"count":48,"latest_published_at":49},"Deals","deals",179,"2026-06-29T20:02:07.000Z",{"name":51,"slug":52,"count":53,"latest_published_at":54},"Policy","policy",158,"2026-07-16T00:02:48.000Z",{"name":56,"slug":57,"count":58,"latest_published_at":59},"Hardware","hardware",122,"2026-07-14T19:46:26.000Z",{"name":61,"slug":62,"count":63,"latest_published_at":64},"Consumer Tech","consumer-tech",93,"2026-07-13T13:20:48.000Z",{"name":66,"slug":67,"count":68,"latest_published_at":69},"Software","software",70,"2026-07-13T19:52:25.000Z",{"name":71,"slug":72,"count":73,"latest_published_at":74},"Science","science",66,"2026-07-10T10:29:37.000Z",{"name":76,"slug":77,"count":78,"latest_published_at":18},"Dev Tools","dev-tools",59,{"name":80,"slug":81,"count":82,"latest_published_at":83},"Gaming","gaming",41,"2026-07-09T04:00:00.000Z",{"name":85,"slug":86,"count":82,"latest_published_at":87},"Startups","startups","2026-06-29T20:55:50.000Z",{"name":89,"slug":90,"count":91,"latest_published_at":92},"General","general",29,"2026-07-10T22:28:58.000Z",{"name":94,"slug":95,"count":96,"latest_published_at":97},"Reviews","reviews",20,"2026-06-24T12:00:01.000Z",{"name":99,"slug":100,"count":101,"latest_published_at":102},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]