[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-robodojo-bridges-the-sim-to-real-gap-in-robot-benchmarking":10,"sections":44},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":34,"tags":35,"sources":39,"feedback":43,"feedback_at":22,"cost_usd":43,"total_tokens":43},3944,"robodojo-bridges-the-sim-to-real-gap-in-robot-benchmarking","RoboDojo Bridges the Sim-to-Real Gap in Robot Benchmarking","A new benchmark tests 30 manipulation policies in both simulation and the physical world, exposing how well lab results hold up in deployment.","Robotics research finally has a benchmark that refuses to pick sides between simulation and the real world.\n\nRoboDojo is a new evaluation framework that runs manipulation policies through 42 simulated tasks and 18 physical-world tasks in a single unified system. The simulation side scores policies across five dimensions — generalization, memory, precision, long-horizon execution, and open-vocabulary instruction following — while the real-world component, called RoboDojo-RealEval, uses standardized hardware and remote cloud access to make physical testing reproducible. The team ran 30 existing policies through the full suite and published the results as a public leaderboard.\n\nThe sim-to-real gap is one of robotics' oldest headaches: a policy that aces a simulated kitchen can fail the moment it meets an actual countertop. Most benchmarks pick one environment or the other, which means either cheap-but-misleading simulation scores or expensive, hard-to-replicate lab runs that other teams cannot easily verify. RoboDojo's paired design forces both numbers into the open at once, making the gap itself measurable rather than something researchers quietly acknowledge and move on from.\n\nThirty policies is a reasonable starting set, but the leaderboard's value depends entirely on whether the robotics community adopts the standardized hardware stack — a coordination problem that has sunk more than a few would-be benchmark standards before it.","[\"robotics\",\"benchmarks\",\"ai\",\"research\"]","2026-07-07T04:00:00.000Z","2026-07-07T12:52:40.051Z","2026-07-07T12:52:42.879Z","published",null,[24,30],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"The headline says '30 Robot Policies Through 60 Tasks' but the dek correctly states '42 simulation tasks and 18 real-world tasks' — the headline's '60 tasks' figure is arithmetically accurate but the title reads as a vague placeholder rather than a finished, publication-ready headline that communicates what is actually new or significant about RoboDojo.","resolved",{"id":31,"reviewer":26,"round":32,"reason":33,"status":29},"editor-r2",2,"The headline still reads as a vague placeholder ('Puts 30 Robot Policies Through a Unified Test') rather than a finished, publication-ready headline that communicates what is actually new or significant — rewrite the title to lead with the benchmark's core contribution (e.g., the sim-and-real gap or reproducible physical evaluation) as the dek already does.","ai",[36,37,34,38],"robotics","benchmarks","research",[40],{"name":41,"url":42},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2607.04434",0,{"sections":45},[46,50,55,60,65,70,75,80,85,89,94,98,103,108],{"name":47,"slug":34,"count":48,"latest_published_at":49},"AI",2590,"2026-07-16T04:00:00.000Z",{"name":51,"slug":52,"count":53,"latest_published_at":54},"Security","security",294,"2026-07-15T19:59:48.000Z",{"name":56,"slug":57,"count":58,"latest_published_at":59},"Deals","deals",179,"2026-06-29T20:02:07.000Z",{"name":61,"slug":62,"count":63,"latest_published_at":64},"Policy","policy",158,"2026-07-16T00:02:48.000Z",{"name":66,"slug":67,"count":68,"latest_published_at":69},"Hardware","hardware",122,"2026-07-14T19:46:26.000Z",{"name":71,"slug":72,"count":73,"latest_published_at":74},"Consumer Tech","consumer-tech",93,"2026-07-13T13:20:48.000Z",{"name":76,"slug":77,"count":78,"latest_published_at":79},"Software","software",70,"2026-07-13T19:52:25.000Z",{"name":81,"slug":82,"count":83,"latest_published_at":84},"Science","science",66,"2026-07-10T10:29:37.000Z",{"name":86,"slug":87,"count":88,"latest_published_at":18},"Dev Tools","dev-tools",59,{"name":90,"slug":91,"count":92,"latest_published_at":93},"Gaming","gaming",41,"2026-07-09T04:00:00.000Z",{"name":95,"slug":96,"count":92,"latest_published_at":97},"Startups","startups","2026-06-29T20:55:50.000Z",{"name":99,"slug":100,"count":101,"latest_published_at":102},"General","general",29,"2026-07-10T22:28:58.000Z",{"name":104,"slug":105,"count":106,"latest_published_at":107},"Reviews","reviews",20,"2026-06-24T12:00:01.000Z",{"name":109,"slug":110,"count":111,"latest_published_at":112},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]