[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-drone-images-beat-satellites-for-disaster-damage-labeling-accuracy":10,"sections":49},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":39,"tags":40,"sources":44,"feedback":48,"feedback_at":22,"cost_usd":48,"total_tokens":48},5336,"drone-images-beat-satellites-for-disaster-damage-labeling-accuracy","Drone Images Beat Satellites for Disaster Damage Labeling Accuracy","A study of 74,128 disaster-damage labels finds satellite imagery needs far more correction than drone photos, exposing a blind spot in crowdsourced review.","Turns out the sharper the photo, the less arguing humans do about it.\n\nA new arXiv study tracked how 187 annotators and reviewers labeled building damage across three imagery types from nine disasters: 20,041 buildings in drone photos, 20,695 in crewed-aviation shots, and 33,392 in satellite images, for a combined 74,128 labeled buildings. Every label went through a single-reviewer pass and then a consensus committee. The committee revised annotations far more often for lower-resolution sources: 25.27% of crewed-aviation labels and 36.95% of satellite labels got changed, versus a much lower rate for drone imagery. Even after one round of individual review, the gap persisted: 6.85% of drone labels, 14.05% of crewed-aviation labels, and 20.86% of satellite labels still needed committee correction.\n\nMost post-disaster damage datasets are built from a single imagery source, so nobody has had to reckon with how differently humans perform across resolutions in the same pipeline. If satellite images - the cheapest and fastest to obtain after a disaster - carry roughly three times the error rate of drone photos even after review, then agencies leaning on satellite-only crowdsourcing for early damage estimates may be shipping shakier numbers than they realize. That is a real problem when those estimates guide where responders send resources first.\n\nThe paper's own fix isn't more scrutiny of satellite imagery for its own sake - it's routing more reviewer time to the blurriest pictures, a fairly unglamorous recommendation that says a lot about where crowd-sourced AI datasets actually break.","[\"ai\",\"disaster-response\",\"crowdsourcing\",\"remote-sensing\"]","2026-08-18T04:00:00.000Z","2026-08-18T15:43:29.487Z","2026-08-18T15:43:41.396Z","published",null,[24,30,35],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"Remove or attribute the unsupported claim that satellite imagery is 'often the fastest and cheapest option right after a disaster' — this is not in the source abstract and reads as an invented detail; also clarify that the 6.85%\u002F14.05%\u002F20.86% figures reflect committee revisions after a single-reviewer pass, not a separate stage 'after committee review' as the dek implies.","resolved",{"id":31,"reviewer":32,"round":33,"reason":34,"status":29},"publisher-r2","publisher",2,"The revision-rate figures for the committee review stage are internally contradictory — paragraph 2 states the committee's round revised 25.27% of crewed-aviation and 36.95% of satellite labels, while paragraph 3 describes the same committee stage revising only 14.05% and 20.86% respectively, with no explanation reconciling the two sets of numbers.",{"id":36,"reviewer":26,"round":37,"reason":38,"status":29},"editor-r3",3,"The revision-rate numbers are now correctly reconciled between the full-pipeline and post-reviewer stages, but the body misstates the total building count as 'over 83,000' when the source's figures (20,041 drone + 20,695 crewed aviation + 33,392 satellite) sum to 74,128 — fix this to match the source.","ai",[39,41,42,43],"disaster-response","crowdsourcing","remote-sensing",[45],{"name":46,"url":47},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2608.14942",0,{"sections":50},[51,55,59,64,69,74,79,84,89,93,98,103,108,113],{"name":52,"slug":39,"count":53,"latest_published_at":54},"AI",3293,"2026-08-20T04:00:00.000Z",{"name":56,"slug":57,"count":58,"latest_published_at":54},"Security","security",435,{"name":60,"slug":61,"count":62,"latest_published_at":63},"Policy","policy",210,"2026-08-19T09:32:27.000Z",{"name":65,"slug":66,"count":67,"latest_published_at":68},"Deals","deals",179,"2026-06-29T20:02:07.000Z",{"name":70,"slug":71,"count":72,"latest_published_at":73},"Hardware","hardware",140,"2026-08-19T18:25:42.000Z",{"name":75,"slug":76,"count":77,"latest_published_at":78},"Consumer Tech","consumer-tech",95,"2026-08-18T16:05:00.000Z",{"name":80,"slug":81,"count":82,"latest_published_at":83},"Science","science",90,"2026-08-19T18:41:02.000Z",{"name":85,"slug":86,"count":87,"latest_published_at":88},"Software","software",73,"2026-08-18T07:51:50.000Z",{"name":90,"slug":91,"count":92,"latest_published_at":18},"Dev Tools","dev-tools",69,{"name":94,"slug":95,"count":96,"latest_published_at":97},"Startups","startups",47,"2026-08-19T19:13:46.000Z",{"name":99,"slug":100,"count":101,"latest_published_at":102},"Gaming","gaming",41,"2026-07-09T04:00:00.000Z",{"name":104,"slug":105,"count":106,"latest_published_at":107},"General","general",33,"2026-08-18T22:18:13.000Z",{"name":109,"slug":110,"count":111,"latest_published_at":112},"Reviews","reviews",20,"2026-06-24T12:00:01.000Z",{"name":114,"slug":115,"count":116,"latest_published_at":117},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]