[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-foundation-models-win-on-scarce-labels-then-lose-as-data-grows":10,"sections":41},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":36,"feedback":40,"feedback_at":22,"cost_usd":40,"total_tokens":40},3903,"foundation-models-win-on-scarce-labels-then-lose-as-data-grows","Foundation Models Win on Scarce Labels, Then Lose as Data Grows","Tabular foundation models outperform conventional ML with few labels, but tuned conventional models surpass them as labeled data grows.","A new study finds that tabular foundation models outperform conventional ML when labeled examples are scarce, but lose ground as labels accumulate.\n\nResearchers tested three foundation models and several conventional machine learning models on three real crowd-monitoring datasets from the Hajj and Umrah pilgrimages. Foundation models, which generate predictions from a small number of examples without task-specific training, held a clear accuracy edge when labels were very few. As the label count rose, tuned conventional models caught up and pulled ahead, especially on a structural geometry classification target. On efficiency, foundation models skip tuning costs but reprocess their entire context at each prediction, while tuned conventional models pay a large upfront tuning cost and then predict cheaply.\n\nThe finding matters because most benchmark comparisons assume ample labeled data. This study draws a practical line: below a certain label budget, you reach for a foundation model; above it, you tune a conventional model. For any team working in domains where labeling is expensive, that crossover point is worth knowing before the labeling work starts.\n\nThe paper's output is a decision map, not a champion. That kind of practical, unglamorous result is harder to hype but easier to deploy.","[\"machine learning\",\"tabular data\",\"crowd monitoring\",\"foundation models\"]","2026-07-07T04:00:00.000Z","2026-07-07T11:29:44.533Z","2026-07-07T11:29:47.643Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"The headline and dek are too vague and read as placeholders — 'when to use AI shortcuts' does not name the actual finding; rewrite both to state the concrete result (foundation models lead under low label counts, conventional models surpass them as labels grow) and strip the informal phrase 'AI shortcuts' in favor of plain terminology used in the body.","resolved","ai",[32,33,34,35],"machine learning","tabular data","crowd monitoring","foundation models",[37],{"name":38,"url":39},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2607.04013",0,{"sections":42},[43,47,52,57,62,67,72,77,82,86,91,95,100,105],{"name":44,"slug":30,"count":45,"latest_published_at":46},"AI",2590,"2026-07-16T04:00:00.000Z",{"name":48,"slug":49,"count":50,"latest_published_at":51},"Security","security",294,"2026-07-15T19:59:48.000Z",{"name":53,"slug":54,"count":55,"latest_published_at":56},"Deals","deals",179,"2026-06-29T20:02:07.000Z",{"name":58,"slug":59,"count":60,"latest_published_at":61},"Policy","policy",158,"2026-07-16T00:02:48.000Z",{"name":63,"slug":64,"count":65,"latest_published_at":66},"Hardware","hardware",122,"2026-07-14T19:46:26.000Z",{"name":68,"slug":69,"count":70,"latest_published_at":71},"Consumer Tech","consumer-tech",93,"2026-07-13T13:20:48.000Z",{"name":73,"slug":74,"count":75,"latest_published_at":76},"Software","software",70,"2026-07-13T19:52:25.000Z",{"name":78,"slug":79,"count":80,"latest_published_at":81},"Science","science",66,"2026-07-10T10:29:37.000Z",{"name":83,"slug":84,"count":85,"latest_published_at":18},"Dev Tools","dev-tools",59,{"name":87,"slug":88,"count":89,"latest_published_at":90},"Gaming","gaming",41,"2026-07-09T04:00:00.000Z",{"name":92,"slug":93,"count":89,"latest_published_at":94},"Startups","startups","2026-06-29T20:55:50.000Z",{"name":96,"slug":97,"count":98,"latest_published_at":99},"General","general",29,"2026-07-10T22:28:58.000Z",{"name":101,"slug":102,"count":103,"latest_published_at":104},"Reviews","reviews",20,"2026-06-24T12:00:01.000Z",{"name":106,"slug":107,"count":108,"latest_published_at":109},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]