[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-study-finds-english-is-the-riskiest-language-for-closed-ai-models":10,"sections":41},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":36,"feedback":40,"feedback_at":22,"cost_usd":40,"total_tokens":40},5744,"study-finds-english-is-the-riskiest-language-for-closed-ai-models","Study Finds English Is the Riskiest Language for Closed AI Models","A new India-focused benchmark finds closed-source AI models are riskiest in English, flipping assumptions built on English-centric safety training.","A new benchmark finds that closed-source AI models are more likely to produce biased answers to English speakers than to speakers of Hindi, Bengali, Tamil, Marathi, or Hinglish.\n\nResearchers built INCLUDE, a 2,604-prompt benchmark testing for Indian socio-cultural bias across six languages: English, Hindi, Bengali, Marathi, Tamil, and Hinglish, the common Hindi-English code-mix heard across Indian cities. They ran ten open-source and closed-source LLMs through it, producing 14,988 bias scores. Bengali came out worst for open-source models. English came out best for open-source models, but worst for closed-source ones - a reversal the researchers flag as a key finding.\n\nThat reversal matters because safety alignment for most large models is built and tested almost entirely in English, on the assumption that English is the safest default. For closed-source models, the kind deployed in voice assistants and dialogue systems across India's linguistically diverse population, that assumption breaks down exactly where it is supposed to hold. Users speaking English to these systems got less-safe outputs than the safety-training story would predict, while other Indian languages fared better on the same closed models.\n\nIt is a reminder that aligned in English and aligned are not the same claim, and vendors marketing global safety on the strength of English-language red-teaming should expect that pitch to get tested in exactly the multilingual, code-mixed conversations they did not train for.","[\"ai bias\",\"llm safety\",\"india\",\"multilingual ai\"]","2026-08-20T04:00:00.000Z","2026-08-20T05:09:18.946Z","2026-08-20T05:09:30.875Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"The closing paragraph directly contradicts paragraph two: paragraph two correctly states English is the riskiest language for closed-source models (highest bias score), but the final paragraph claims closed models are 'safer in English but worse elsewhere,' the opposite of the study's finding and of what the article itself just said — fix this internal contradiction so the characterization is consistent throughout.","resolved","ai",[32,33,34,35],"ai bias","llm safety","india","multilingual ai",[37],{"name":38,"url":39},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2608.18131",0,{"sections":42},[43,46,50,55,60,65,70,75,80,85,90,95,100,105],{"name":44,"slug":30,"count":45,"latest_published_at":18},"AI",3293,{"name":47,"slug":48,"count":49,"latest_published_at":18},"Security","security",435,{"name":51,"slug":52,"count":53,"latest_published_at":54},"Policy","policy",210,"2026-08-19T09:32:27.000Z",{"name":56,"slug":57,"count":58,"latest_published_at":59},"Deals","deals",179,"2026-06-29T20:02:07.000Z",{"name":61,"slug":62,"count":63,"latest_published_at":64},"Hardware","hardware",140,"2026-08-19T18:25:42.000Z",{"name":66,"slug":67,"count":68,"latest_published_at":69},"Consumer Tech","consumer-tech",95,"2026-08-18T16:05:00.000Z",{"name":71,"slug":72,"count":73,"latest_published_at":74},"Science","science",90,"2026-08-19T18:41:02.000Z",{"name":76,"slug":77,"count":78,"latest_published_at":79},"Software","software",73,"2026-08-18T07:51:50.000Z",{"name":81,"slug":82,"count":83,"latest_published_at":84},"Dev Tools","dev-tools",69,"2026-08-18T04:00:00.000Z",{"name":86,"slug":87,"count":88,"latest_published_at":89},"Startups","startups",47,"2026-08-19T19:13:46.000Z",{"name":91,"slug":92,"count":93,"latest_published_at":94},"Gaming","gaming",41,"2026-07-09T04:00:00.000Z",{"name":96,"slug":97,"count":98,"latest_published_at":99},"General","general",33,"2026-08-18T22:18:13.000Z",{"name":101,"slug":102,"count":103,"latest_published_at":104},"Reviews","reviews",20,"2026-06-24T12:00:01.000Z",{"name":106,"slug":107,"count":108,"latest_published_at":109},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]