[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-new-framework-detects-robot-ai-failures-without-step-labels":10,"sections":41},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":36,"feedback":40,"feedback_at":22,"cost_usd":40,"total_tokens":40},8147,"new-framework-detects-robot-ai-failures-without-step-labels","New Framework Detects Robot AI Failures Without Step Labels","A new framework called Hide-and-Seek detects robot AI failures mid-task from coarse labels alone, trading some accuracy for faster, more timely detection.","Robots powered by vision-language-action models fail more often than their demos suggest, and a new detection framework aims to catch those failures while they are happening, not after.\n\nResearchers behind a system called Hide-and-Seek trained a failure detector using only trajectory-level labels - a single pass or fail tag for an entire robot run - instead of expensive per-step annotations or resampling every action. The framework applies contrastive learning both across and within trajectories to pinpoint which specific actions in a failed run actually caused the problem, turning one coarse label into a localized failure signal. The team tested it on three VLA policies, OpenVLA, pi0, and pi0.5, across two simulation benchmarks, LIBERO and VLABench, plus a real robotic platform, and reported state-of-the-art multi-task failure detection results, including generalization to tasks the model had not seen during training.\n\nVLA models let robots follow plain-language commands, but they are notoriously unreliable in execution, and existing failure detectors either need extra model calls to resample actions or apply one blunt label to an entire trajectory, obscuring exactly when things went wrong. Hide-and-Seek uses conformal prediction to explicitly balance accuracy against timeliness rather than claiming a win on both fronts - a real-world robot that flags an error three steps too late has already dropped what it was carrying.\n\nThat trade-off framing is unusually honest for a benchmark paper: the claim is not that it catches everything, but that it catches more, sooner, with less supervision than prior approaches - a narrower win, but a more useful one for anyone running robots outside a lab.","[\"robotics\",\"vla models\",\"failure detection\",\"ai research\"]","2026-09-28T04:00:00.000Z","2026-09-28T11:26:57.847Z","2026-09-28T11:27:04.089Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"The dek claims the method is 'beating prior methods on accuracy and speed,' but the source and the body itself describe a trade-off (conformal prediction balances accuracy against timeliness) rather than superiority on both axes simultaneously — rewrite the dek to reflect the accuracy-timeliness trade-off rather than implying it wins outright on both.","resolved","ai",[32,33,34,35],"robotics","vla models","failure detection","ai research",[37],{"name":38,"url":39},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2605.30834",0,{"sections":42},[43,46,50,55,60,65,69,74,79,84,89,94,98,103],{"name":44,"slug":30,"count":45,"latest_published_at":18},"AI",4798,{"name":47,"slug":48,"count":49,"latest_published_at":18},"Security","security",762,{"name":51,"slug":52,"count":53,"latest_published_at":54},"Policy","policy",399,"2026-09-27T18:39:02.000Z",{"name":56,"slug":57,"count":58,"latest_published_at":59},"Deals","deals",261,"2026-09-27T15:30:35.000Z",{"name":61,"slug":62,"count":63,"latest_published_at":64},"Hardware","hardware",188,"2026-09-27T20:46:36.000Z",{"name":66,"slug":67,"count":68,"latest_published_at":18},"Science","science",151,{"name":70,"slug":71,"count":72,"latest_published_at":73},"Consumer Tech","consumer-tech",135,"2026-09-26T14:30:00.000Z",{"name":75,"slug":76,"count":77,"latest_published_at":78},"Software","software",91,"2026-09-25T20:55:00.000Z",{"name":80,"slug":81,"count":82,"latest_published_at":83},"Dev Tools","dev-tools",84,"2026-09-26T04:20:58.000Z",{"name":85,"slug":86,"count":87,"latest_published_at":88},"Startups","startups",76,"2026-09-25T18:33:59.000Z",{"name":90,"slug":91,"count":92,"latest_published_at":93},"Gaming","gaming",48,"2026-09-25T18:35:21.000Z",{"name":95,"slug":96,"count":92,"latest_published_at":97},"General","general","2026-09-26T17:02:42.000Z",{"name":99,"slug":100,"count":101,"latest_published_at":102},"Reviews","reviews",30,"2026-09-24T20:07:31.000Z",{"name":104,"slug":105,"count":106,"latest_published_at":107},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]