[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-study-mines-150-ai-system-failures-into-a-resilience-playbook":10,"sections":40},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":35,"feedback":39,"feedback_at":22,"cost_usd":39,"total_tokens":39},9991,"study-mines-150-ai-system-failures-into-a-resilience-playbook","Study Mines 150 AI System Failures Into a Resilience Playbook","A 150-incident study finds circuit breakers alone cut cascade errors by 89%, while stacking three-plus resilience patterns cuts recovery time by 71%.","A new study turns 150 real AI system meltdowns into a field guide for not repeating them.\n\nResearchers analyzed 150 production incident reports from open-source compound AI projects and anonymized enterprise deployments, building a taxonomy of 23 failure modes across five categories: retrieval, generation, tool, orchestration, and integration failures. They tested fixes with controlled fault injection experiments. Circuit breakers alone cut cascade propagation - errors spreading from one component to another - by 89%. Output quality gates caught 73% of silent quality degradation before it reached users, and isolating components cut a failure's blast radius by 64%.\n\nThe 71% drop in mean-time-to-recovery only showed up in systems stacking three or more of these patterns together, not from any single fix. That is the real finding: resilience in multi-component AI systems is additive, not a silver bullet. Compound AI systems - chains of retrieval steps, tools, and models - fail at the seams between components, not inside any one model, which is exactly where most teams aren't looking.\n\nCall it the DevOps lesson tech keeps relearning: monitoring a system's parts tells you nothing about how they fail together.","[\"ai\",\"reliability\",\"compound-ai\",\"research\"]","2026-10-05T04:00:00.000Z","2026-10-05T16:59:16.716Z","2026-10-05T16:59:23.015Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"The dek attributes the 71% MTTR reduction to circuit breakers alone, but the source says that figure applies only to systems combining three or more resilience patterns (circuit breakers alone cut cascade propagation by 89%) — fix the dek to correctly attribute the 71% stat.","resolved","ai",[30,32,33,34],"reliability","compound-ai","research",[36],{"name":37,"url":38},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2610.02503",0,{"sections":41},[42,45,49,54,59,64,68,73,77,82,87,92,97,102],{"name":43,"slug":30,"count":44,"latest_published_at":18},"AI",6233,{"name":46,"slug":47,"count":48,"latest_published_at":18},"Security","security",868,{"name":50,"slug":51,"count":52,"latest_published_at":53},"Policy","policy",444,"2026-10-03T15:02:01.000Z",{"name":55,"slug":56,"count":57,"latest_published_at":58},"Deals","deals",323,"2026-10-04T13:00:00.000Z",{"name":60,"slug":61,"count":62,"latest_published_at":63},"Hardware","hardware",204,"2026-10-03T14:50:50.000Z",{"name":65,"slug":66,"count":67,"latest_published_at":18},"Science","science",177,{"name":69,"slug":70,"count":71,"latest_published_at":72},"Consumer Tech","consumer-tech",158,"2026-10-03T03:21:12.000Z",{"name":74,"slug":75,"count":76,"latest_published_at":18},"Dev Tools","dev-tools",98,{"name":78,"slug":79,"count":80,"latest_published_at":81},"Software","software",97,"2026-10-04T10:00:00.000Z",{"name":83,"slug":84,"count":85,"latest_published_at":86},"Startups","startups",92,"2026-10-04T14:36:25.000Z",{"name":88,"slug":89,"count":90,"latest_published_at":91},"Gaming","gaming",53,"2026-10-02T02:50:39.000Z",{"name":93,"slug":94,"count":95,"latest_published_at":96},"General","general",51,"2026-10-05T02:35:01.000Z",{"name":98,"slug":99,"count":100,"latest_published_at":101},"Reviews","reviews",32,"2026-10-02T18:00:00.000Z",{"name":103,"slug":104,"count":105,"latest_published_at":106},"How-To","how-to",7,"2026-10-01T09:00:00.000Z"]