[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-ai-pedestrian-safety-scores-lag-far-behind-human-judgment":10,"sections":40},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":35,"feedback":39,"feedback_at":22,"cost_usd":39,"total_tokens":39},9023,"ai-pedestrian-safety-scores-lag-far-behind-human-judgment","AI Pedestrian Safety Scores Lag Far Behind Human Judgment","A new AI tool that rates how safe city blocks feel badly trailed human raters in real-world tests, despite doing fine on lab benchmarks.","An AI tool built to score how safe a street feels turns out to agree with people only weakly once it leaves the lab.\n\nResearchers built a pedestrian routing system that estimates perceived safety from street-level photos. Rather than scoring images directly, it first generates a plain-language caption for each photo, then derives a risk score from structured features of that text, so every judgment stays inspectable instead of hiding inside a black box. The team tested nine captioning setups across five model families and found the caption-based scores matched a direct image-embedding baseline rather than trailing it. They then ran the pipeline across 654,115 images covering 36 electoral wards in Manchester and Huddersfield.\n\nWhen checked against 3,669 ratings collected from real people in the field, the AI's agreement with human judgment was modest: a correlation of 0.262, well short of the 0.737 ceiling set by how much the human raters agreed with each other. A follow-up test made the pipeline 44% stronger on its lab benchmark and saw no measurable improvement in the field (r=0.250, p=0.84), evidence that benchmark gains here did not translate to real-world accuracy.\n\nThe system still reroutes walkers toward lower-risk streets, adding a median 12.78% more route length on trips of 3 to 6 km. That's a real behavioral change built on a signal that, by the researchers' own numbers, still falls well short of matching how people actually judge a street.","[\"ai\",\"computer-vision\",\"urban-safety\",\"research\"]","2026-10-01T04:00:00.000Z","2026-10-01T16:12:54.535Z","2026-10-01T16:12:58.345Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"Fix the dek: it claims the AI 'barely beat human disagreement' but the body shows the opposite — the AI's field correlation (0.262) fell far below the human-agreement ceiling (0.737), so the dek should state it badly underperformed human agreement, not barely matched it.","resolved","ai",[30,32,33,34],"computer-vision","urban-safety","research",[36],{"name":37,"url":38},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2609.38479",0,{"sections":41},[42,45,49,54,59,64,68,73,78,82,87,92,97,102],{"name":43,"slug":30,"count":44,"latest_published_at":18},"AI",5488,{"name":46,"slug":47,"count":48,"latest_published_at":18},"Security","security",809,{"name":50,"slug":51,"count":52,"latest_published_at":53},"Policy","policy",429,"2026-10-01T02:26:17.000Z",{"name":55,"slug":56,"count":57,"latest_published_at":58},"Deals","deals",298,"2026-09-30T21:00:26.000Z",{"name":60,"slug":61,"count":62,"latest_published_at":63},"Hardware","hardware",196,"2026-09-30T13:00:00.000Z",{"name":65,"slug":66,"count":67,"latest_published_at":18},"Science","science",162,{"name":69,"slug":70,"count":71,"latest_published_at":72},"Consumer Tech","consumer-tech",149,"2026-09-30T22:57:11.000Z",{"name":74,"slug":75,"count":76,"latest_published_at":77},"Dev Tools","dev-tools",93,"2026-10-01T02:30:48.000Z",{"name":79,"slug":80,"count":76,"latest_published_at":81},"Software","software","2026-09-30T21:41:11.000Z",{"name":83,"slug":84,"count":85,"latest_published_at":86},"Startups","startups",84,"2026-09-30T20:39:09.000Z",{"name":88,"slug":89,"count":90,"latest_published_at":91},"Gaming","gaming",51,"2026-09-30T16:24:30.000Z",{"name":93,"slug":94,"count":95,"latest_published_at":96},"General","general",50,"2026-09-30T21:37:54.000Z",{"name":98,"slug":99,"count":100,"latest_published_at":101},"Reviews","reviews",31,"2026-09-28T14:31:34.000Z",{"name":103,"slug":104,"count":105,"latest_published_at":106},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]