[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-ai-agents-automate-the-robot-simulation-pipeline":10,"sections":41},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":36,"feedback":40,"feedback_at":22,"cost_usd":40,"total_tokens":40},6715,"ai-agents-automate-the-robot-simulation-pipeline","AI Agents Automate the Robot Simulation Pipeline","A new framework uses vision-language agents to turn real robot footage into runnable simulations at a fraction of frontier-AI cost.","A new AI framework turns raw video of a robot handling objects into a ready-to-use physics simulation.\n\nResearchers have introduced Agentic Real2Sim, a framework that uses vision-language agents to convert real-world recordings of robot-object interaction into simulatable digital twins, then hands those twins off for policy fine-tuning and evaluation. The pitch is that today's real2sim conversion is manual and brittle: it strings together separate visual-perception tools, mesh cleanup, and coordinate-frame alignment by hand. Agentic Real2Sim replaces that glue work with agent-driven automation and was tested across rigid-object manipulation, deformable-object interaction, and humanoid motion, three domains that normally need separate pipelines. The researchers also report that the framework's agentic decisions can run on an open-weight vision-language model at a small fraction of the cost of frontier models, while reaching a comparable conversion success rate.\n\nThe more interesting claim isn't the automation itself, it's the consolidation. Real2sim has been a bottleneck for robot learning partly because every new object type or motion domain has typically needed its own tooling. Folding rigid, deformable, and humanoid conversion into one agentic workflow, running on cheap open-weight models, lowers the cost of generating training and evaluation data for robot policies, not just building one-off simulations.\n\nThe underlying paper does not publish the actual success-rate numbers behind that cost comparison, so treat 'comparable to frontier models' as a self-reported result until outside groups put the released code, hosted on the project's site, through independent testing.","[\"robotics\",\"ai-agents\",\"simulation\",\"vision-language-models\"]","2026-09-17T04:00:00.000Z","2026-09-18T07:26:16.018Z","2026-09-18T07:26:27.926Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"Remove or clearly flag as analysis the unsupported specifics not found in the source — the claim that manual real2sim tuning can 'take an engineer days' and the assertion that labs have spent 'the past two years' bolting agentic AI onto the pipeline are both presented as established fact but are not substantiated by the arXiv abstract.","resolved","ai",[32,33,34,35],"robotics","ai-agents","simulation","vision-language-models",[37],{"name":38,"url":39},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2607.19190",0,{"sections":42},[43,47,51,56,61,65,69,74,79,83,88,93,98,103],{"name":44,"slug":30,"count":45,"latest_published_at":46},"AI",3852,"2026-09-17T08:27:09.000Z",{"name":48,"slug":49,"count":50,"latest_published_at":18},"Security","security",648,{"name":52,"slug":53,"count":54,"latest_published_at":55},"Policy","policy",338,"2026-09-11T04:00:00.000Z",{"name":57,"slug":58,"count":59,"latest_published_at":60},"Deals","deals",179,"2026-06-29T20:02:07.000Z",{"name":62,"slug":63,"count":64,"latest_published_at":18},"Hardware","hardware",154,{"name":66,"slug":67,"count":68,"latest_published_at":18},"Science","science",114,{"name":70,"slug":71,"count":72,"latest_published_at":73},"Consumer Tech","consumer-tech",99,"2026-09-09T17:27:33.000Z",{"name":75,"slug":76,"count":77,"latest_published_at":78},"Software","software",75,"2026-09-10T20:41:21.000Z",{"name":80,"slug":81,"count":82,"latest_published_at":18},"Dev Tools","dev-tools",73,{"name":84,"slug":85,"count":86,"latest_published_at":87},"Startups","startups",55,"2026-09-09T23:14:29.000Z",{"name":89,"slug":90,"count":91,"latest_published_at":92},"Gaming","gaming",43,"2026-09-10T12:18:06.000Z",{"name":94,"slug":95,"count":96,"latest_published_at":97},"General","general",41,"2026-09-08T01:57:23.000Z",{"name":99,"slug":100,"count":101,"latest_published_at":102},"Reviews","reviews",20,"2026-06-24T12:00:01.000Z",{"name":104,"slug":105,"count":106,"latest_published_at":107},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]