[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-a-smarter-way-to-find-ai-failures-before-they-happen":10,"sections":35},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":24,"persona_id":22,"persona_name":22,"section":25,"tags":26,"sources":30,"feedback":34,"feedback_at":22,"cost_usd":34,"total_tokens":34},2474,"a-smarter-way-to-find-ai-failures-before-they-happen","A Smarter Way to Find AI Failures Before They Happen","SCARCE replaces hand-tuned safety testing with learned embeddings, cutting rare-event estimation error by up to 500x compared to traditional methods.","Estimating how often an AI system fails in rare but dangerous ways just got meaningfully cheaper.\n\nResearchers have published SCARCE, a method for quantifying the probability of rare AI failures without the massive computational budgets that brute-force testing requires. Classical approaches — called Subset Simulation — need a hand-crafted scoring function that essentially describes what failure looks like in advance, a requirement that limits how well the method transfers across domains. SCARCE sidesteps that by learning latent representations of failure regions directly from data, then using geometric distance to score how close any given input is to going wrong. The system also provides a mathematically grounded upper bound on failure probability, valid even when you stop testing early.\n\nThe practical payoff is significant for anyone trying to measure safety margins at scale. On a standard image misclassification benchmark, SCARCE achieved 400-500 times lower mean absolute error than grid-searched traditional Subset Simulation. On LLM jailbreak detection using Llama-Guard-3-8B's internal states, the method hit 2.6% mean relative error for adversarial fractions as low as 1-in-1,000 — a regime where brute-force sampling would be prohibitively expensive.\n\nAI safety testing has long been hobbled by a fundamental mismatch: the failures that matter most are the ones that happen least, making them hardest to measure. SCARCE doesn't eliminate that tension, but it dramatically reduces the sample budget needed to get a credible estimate — which matters most for developers who need to certify system behavior before deployment, not just after an incident.","[\"ai\",\"safety\",\"research\",\"llm\"]","2026-06-30T04:00:00.000Z","2026-06-30T06:15:11.080Z","2026-06-30T06:15:21.035Z","published",null,[],"https:\u002F\u002Fcdn.xyz.onl\u002Farticle-images\u002Fa-smarter-way-to-find-ai-failures-before-they-happen.webp","ai",[25,27,28,29],"safety","research","llm",[31],{"name":32,"url":33},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2606.29623",0,{"sections":36},[37,41,46,51,56,61,66,71,76,81,86,90,95,100],{"name":38,"slug":25,"count":39,"latest_published_at":40},"AI",2590,"2026-07-16T04:00:00.000Z",{"name":42,"slug":43,"count":44,"latest_published_at":45},"Security","security",294,"2026-07-15T19:59:48.000Z",{"name":47,"slug":48,"count":49,"latest_published_at":50},"Deals","deals",179,"2026-06-29T20:02:07.000Z",{"name":52,"slug":53,"count":54,"latest_published_at":55},"Policy","policy",158,"2026-07-16T00:02:48.000Z",{"name":57,"slug":58,"count":59,"latest_published_at":60},"Hardware","hardware",122,"2026-07-14T19:46:26.000Z",{"name":62,"slug":63,"count":64,"latest_published_at":65},"Consumer Tech","consumer-tech",93,"2026-07-13T13:20:48.000Z",{"name":67,"slug":68,"count":69,"latest_published_at":70},"Software","software",70,"2026-07-13T19:52:25.000Z",{"name":72,"slug":73,"count":74,"latest_published_at":75},"Science","science",66,"2026-07-10T10:29:37.000Z",{"name":77,"slug":78,"count":79,"latest_published_at":80},"Dev Tools","dev-tools",59,"2026-07-07T04:00:00.000Z",{"name":82,"slug":83,"count":84,"latest_published_at":85},"Gaming","gaming",41,"2026-07-09T04:00:00.000Z",{"name":87,"slug":88,"count":84,"latest_published_at":89},"Startups","startups","2026-06-29T20:55:50.000Z",{"name":91,"slug":92,"count":93,"latest_published_at":94},"General","general",29,"2026-07-10T22:28:58.000Z",{"name":96,"slug":97,"count":98,"latest_published_at":99},"Reviews","reviews",20,"2026-06-24T12:00:01.000Z",{"name":101,"slug":102,"count":103,"latest_published_at":104},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]