[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-a-smarter-way-to-pick-vision-language-models":10,"sections":39},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":34,"feedback":38,"feedback_at":22,"cost_usd":38,"total_tokens":38},6932,"a-smarter-way-to-pick-vision-language-models","A Smarter Way to Pick Vision Language Models","A new framework scores how well a vision-language model will transfer to a task by reading its internal layer activity, without running it first.","A new paper offers a shortcut for picking the right vision-language model without running it on your data first.\n\nResearchers built a framework that scores how well a pretrained VLM will transfer to a new task by looking at the model's internal wiring rather than test-set accuracy. It measures layer-wise conductance - essentially how much each block of the visual encoder contributes to a task - then builds a profile of which blocks matter most for a target task. A new metric called Directional Conductance Divergence compares that profile against other tasks the model has already handled, in one direction only, since a model that's good at task A won't necessarily be good at task B the same way it's good at task C. Tested across 48 VLMs and 21 datasets, the approach outperformed multiple state-of-the-art selection baselines, including a 14.7% NDCG@5 improvement over one called SWAB.\n\nThat's a meaningful fix for a real bottleneck. Teams building products on open VLMs currently either run expensive few-shot evaluations across candidate models or lean on generic text descriptions of a task that ignore how transfer actually works inside the network. A method that predicts rankings without extra inference could save real compute for anyone shipping VLM-backed features.\n\nDirectional, asymmetric transferability makes intuitive sense - not every skill transfers both ways - but the real test is whether this holds up outside the benchmark suite. Beating multiple state-of-the-art baselines, including that 14.7% NDCG@5 edge over SWAB, is a solid showing on paper. Whether it survives contact with messier, real-world task definitions is a separate question.","[\"ai\",\"vision-language-models\",\"model-selection\"]","2026-09-18T04:00:00.000Z","2026-09-18T23:16:49.299Z","2026-09-18T23:17:01.248Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"The closing skepticism claims the paper 'only benchmarks against one prior baseline,' but the source abstract states the method 'outperforms state-of-the-art baselines' (plural) with 14.7% NDCG@5 specifically over SWAB — correct or remove the single-baseline claim so it doesn't contradict the source.","resolved","ai",[30,32,33],"vision-language-models","model-selection",[35],{"name":36,"url":37},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2602.01346",0,{"sections":40},[41,44,48,53,58,62,66,71,75,80,85,90,95,100],{"name":42,"slug":30,"count":43,"latest_published_at":18},"AI",4082,{"name":45,"slug":46,"count":47,"latest_published_at":18},"Security","security",661,{"name":49,"slug":50,"count":51,"latest_published_at":52},"Policy","policy",339,"2026-09-17T12:00:00.000Z",{"name":54,"slug":55,"count":56,"latest_published_at":57},"Deals","deals",179,"2026-06-29T20:02:07.000Z",{"name":59,"slug":60,"count":61,"latest_published_at":18},"Hardware","hardware",155,{"name":63,"slug":64,"count":65,"latest_published_at":18},"Science","science",125,{"name":67,"slug":68,"count":69,"latest_published_at":70},"Consumer Tech","consumer-tech",99,"2026-09-09T17:27:33.000Z",{"name":72,"slug":73,"count":74,"latest_published_at":18},"Dev Tools","dev-tools",78,{"name":76,"slug":77,"count":78,"latest_published_at":79},"Software","software",75,"2026-09-10T20:41:21.000Z",{"name":81,"slug":82,"count":83,"latest_published_at":84},"Startups","startups",55,"2026-09-09T23:14:29.000Z",{"name":86,"slug":87,"count":88,"latest_published_at":89},"Gaming","gaming",43,"2026-09-10T12:18:06.000Z",{"name":91,"slug":92,"count":93,"latest_published_at":94},"General","general",41,"2026-09-08T01:57:23.000Z",{"name":96,"slug":97,"count":98,"latest_published_at":99},"Reviews","reviews",20,"2026-06-24T12:00:01.000Z",{"name":101,"slug":102,"count":103,"latest_published_at":104},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]