[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-new-method-finds-robot-ai-models-fail-on-tiny-camera-shifts":10,"sections":34},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":24,"tags":25,"sources":29,"feedback":33,"feedback_at":22,"cost_usd":33,"total_tokens":33},7316,"new-method-finds-robot-ai-models-fail-on-tiny-camera-shifts","New Method Finds Robot AI Models Fail on Tiny Camera Shifts","A new validation method shows robot-control AI models can flip decisions from one-degree camera rotations, while vision-language models stay far more robust.","Robots that rely on today's vision-language-action models can flip their next move if a camera rotates by as little as one degree - and the usual way of testing these systems would likely miss it.\n\nResearchers built a validation tool called H2V-M, an upgrade to an earlier framework named H2V, that checks entire continuous ranges of camera perturbations instead of spot-checking a handful of examples. They ran it against six vision-language models from the Gemma, InternVL, LLaVA, and Qwen families, plus five vision-language-action models from the GR00T, OpenVLA, and pi families. The perturbations covered brightness shifts, camera rotations, and combinations of both. H2V-M needed roughly a tenth as many model queries as the original H2V method and found failure cases faster than random sampling, all while still guaranteeing it hadn't missed a failure anywhere in the tested range.\n\nThe interesting result isn't the tool - it's what it found. Robustness tracked the type of perturbation far more than which model was tested, and robot-control models buckled under camera rotations that vision-only chatbots shrugged off. That matters for anyone bolting one of these models onto a robot arm or a warehouse picker, where a slightly crooked camera mount is a Tuesday, not an edge case.\n\nBigger models weren't safer models, either: robustness tracked with which model family a system came from, not how many parameters it had, undercutting the assumption that scale buys reliability for free.\n\nSampling-based robustness claims should be read with that one-degree number in mind - a benchmark that never stumbled onto the wrong rotation angle isn't evidence of safety, just evidence of bad luck avoided.","[\"ai\",\"robotics\",\"robustness-testing\",\"vision-language-models\"]","2026-09-23T04:00:00.000Z","2026-09-23T07:03:34.687Z","2026-09-23T07:03:41.138Z","published",null,[],"ai",[24,26,27,28],"robotics","robustness-testing","vision-language-models",[30],{"name":31,"url":32},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2609.22293",0,{"sections":35},[36,39,43,48,53,58,62,67,72,77,82,87,92,97],{"name":37,"slug":24,"count":38,"latest_published_at":18},"AI",4264,{"name":40,"slug":41,"count":42,"latest_published_at":18},"Security","security",707,{"name":44,"slug":45,"count":46,"latest_published_at":47},"Policy","policy",369,"2026-09-23T02:13:52.000Z",{"name":49,"slug":50,"count":51,"latest_published_at":52},"Deals","deals",202,"2026-09-22T23:00:04.000Z",{"name":54,"slug":55,"count":56,"latest_published_at":57},"Hardware","hardware",168,"2026-09-22T23:56:03.000Z",{"name":59,"slug":60,"count":61,"latest_published_at":18},"Science","science",133,{"name":63,"slug":64,"count":65,"latest_published_at":66},"Consumer Tech","consumer-tech",110,"2026-09-22T20:00:00.000Z",{"name":68,"slug":69,"count":70,"latest_published_at":71},"Software","software",80,"2026-09-22T23:32:52.000Z",{"name":73,"slug":74,"count":75,"latest_published_at":76},"Dev Tools","dev-tools",79,"2026-09-22T22:21:13.000Z",{"name":78,"slug":79,"count":80,"latest_published_at":81},"Startups","startups",65,"2026-09-22T22:06:48.000Z",{"name":83,"slug":84,"count":85,"latest_published_at":86},"Gaming","gaming",45,"2026-09-22T15:35:06.000Z",{"name":88,"slug":89,"count":90,"latest_published_at":91},"General","general",43,"2026-09-21T23:48:56.000Z",{"name":93,"slug":94,"count":95,"latest_published_at":96},"Reviews","reviews",27,"2026-09-22T13:00:00.000Z",{"name":98,"slug":99,"count":100,"latest_published_at":101},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]