[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-ai-emotion-detectors-lean-too-hard-on-what-you-say":10,"sections":40},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":35,"feedback":39,"feedback_at":22,"cost_usd":39,"total_tokens":39},9147,"ai-emotion-detectors-lean-too-hard-on-what-you-say","AI Emotion Detectors Lean Too Hard on What You Say","A transparency method shows speech-emotion AI over-relies on text and that removing cues like speech rate can flip predictions without moving overall scores.","A new study pries open AI speech emotion detectors and finds they are mostly reading the transcript, not the voice.\n\nResearchers adapted concept bottleneck models, a technique borrowed from image classification, to speech emotion recognition. Instead of feeding raw audio straight into a model, they extracted explicit concepts first: transcripts, descriptions of acoustic qualities, and speaker attributes. Testing three large language models on three benchmark datasets (CREMA-D, IEMOCAP, and MELD), they found that in a zero-shot setting the models leaned so hard on the transcript that performance on CREMA-D collapsed, with the Macro-F1 score dropping from 27.8 to 5.8. Fine-tuning reversed that effect: once fine-tuned, adding the transcript back in actually helped, lifting Macro-F1 from 41.8 to 45.1.\n\nThe more interesting finding is buried past the headline numbers. Stripping out a single concept, like speech rate, flipped 48 percent of \"Neutral\" labels to \"Disgust\" on CREMA-D. Separately, removing intensity level on MELD reshuffled many individual predictions even though the overall Macro-F1 score barely changed.\n\nThat is a useful reminder for anyone shopping an off-the-shelf model for sentiment or emotion detection: the leaderboard number is not the whole story, and sometimes not even most of it.","[\"ai\",\"speech emotion recognition\",\"explainability\",\"benchmarks\"]","2026-10-01T04:00:00.000Z","2026-10-01T22:25:53.346Z","2026-10-01T22:25:55.280Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"The dek claims fixing the transcript bias 'introduces' a new, less obvious one, but the source presents the speech-rate\u002Fintensity findings as separate observations about concept removal, not as a bias caused by fixing the transcript issue — reword the dek to drop that unsupported causal link.","resolved","ai",[30,32,33,34],"speech emotion recognition","explainability","benchmarks",[36],{"name":37,"url":38},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2609.39453",0,{"sections":41},[42,45,49,53,58,63,67,72,77,81,86,91,96,101],{"name":43,"slug":30,"count":44,"latest_published_at":18},"AI",5572,{"name":46,"slug":47,"count":48,"latest_published_at":18},"Security","security",815,{"name":50,"slug":51,"count":52,"latest_published_at":18},"Policy","policy",430,{"name":54,"slug":55,"count":56,"latest_published_at":57},"Deals","deals",298,"2026-09-30T21:00:26.000Z",{"name":59,"slug":60,"count":61,"latest_published_at":62},"Hardware","hardware",196,"2026-09-30T13:00:00.000Z",{"name":64,"slug":65,"count":66,"latest_published_at":18},"Science","science",163,{"name":68,"slug":69,"count":70,"latest_published_at":71},"Consumer Tech","consumer-tech",149,"2026-09-30T22:57:11.000Z",{"name":73,"slug":74,"count":75,"latest_published_at":76},"Dev Tools","dev-tools",93,"2026-10-01T02:30:48.000Z",{"name":78,"slug":79,"count":75,"latest_published_at":80},"Software","software","2026-09-30T21:41:11.000Z",{"name":82,"slug":83,"count":84,"latest_published_at":85},"Startups","startups",84,"2026-09-30T20:39:09.000Z",{"name":87,"slug":88,"count":89,"latest_published_at":90},"Gaming","gaming",51,"2026-09-30T16:24:30.000Z",{"name":92,"slug":93,"count":94,"latest_published_at":95},"General","general",50,"2026-09-30T21:37:54.000Z",{"name":97,"slug":98,"count":99,"latest_published_at":100},"Reviews","reviews",31,"2026-09-28T14:31:34.000Z",{"name":102,"slug":103,"count":104,"latest_published_at":105},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]