[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-routing-entropy-doesnt-beat-confidence-at-catching-errors":10,"sections":34},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":24,"tags":25,"sources":29,"feedback":33,"feedback_at":22,"cost_usd":33,"total_tokens":33},9540,"routing-entropy-doesnt-beat-confidence-at-catching-errors","Routing Entropy Doesn't Beat Confidence at Catching Errors","A new audit finds routing entropy in vision transformers adds almost nothing beyond the model's own confidence score.","A new audit finds that routing entropy, the internal confusion level of a dynamic neural network, mostly isn't a useful warning sign beyond what the model's confidence score already tells you.\n\nResearchers tested two image classifiers, Attention-Residual versions of Swin-Tiny and DeiT-Small, trained from scratch on CIFAR-10 and CIFAR-100. Each model produces a routing trace alongside its prediction, a record of how its internal pathways activated, and the assumption in some uncertainty research is that a scattered, high-entropy trace flags a shaky answer. The team ran three checks: does the signal show up at a fixed confidence level, does it hold up across repeated training runs with different random seeds, and can a separate predictor actually extract useful information from it. Across 24 paired training runs, none of the 30 statistical tests survived correction for multiple comparisons, and the one borderline positive result did not reappear when the run was repeated with a different seed.\n\nThe interesting part is what the routing trace could do: it beat a shuffled, meaningless version of itself at predicting correctness, but it still lost to the model's own confidence score on both standard scoring methods. That is the distinction worth flagging - beating noise is not the same as beating the baseline you already have. The team also measured how large a real effect would need to be before their test could catch it, and found their method would miss a meaningful share of a true signal even in the best case, below the bar they had set for trusting it on real labels.\n\nThe paper does not declare routing entropy worthless, only that this detector was not sharp enough to prove otherwise - worth remembering next time a demo claims to read a model's mind by watching which internal pathways light up.","[\"ai\",\"machine-learning\",\"research\",\"transformers\"]","2026-10-02T04:00:00.000Z","2026-10-02T23:46:21.397Z","2026-10-02T23:46:26.970Z","published",null,[],"ai",[24,26,27,28],"machine-learning","research","transformers",[30],{"name":31,"url":32},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2610.01495",0,{"sections":35},[36,39,43,47,52,56,60,65,70,75,80,85,90,95],{"name":37,"slug":24,"count":38,"latest_published_at":18},"AI",5895,{"name":40,"slug":41,"count":42,"latest_published_at":18},"Security","security",837,{"name":44,"slug":45,"count":46,"latest_published_at":18},"Policy","policy",438,{"name":48,"slug":49,"count":50,"latest_published_at":51},"Deals","deals",317,"2026-10-01T22:00:00.000Z",{"name":53,"slug":54,"count":55,"latest_published_at":18},"Hardware","hardware",199,{"name":57,"slug":58,"count":59,"latest_published_at":18},"Science","science",171,{"name":61,"slug":62,"count":63,"latest_published_at":64},"Consumer Tech","consumer-tech",155,"2026-10-01T19:54:10.000Z",{"name":66,"slug":67,"count":68,"latest_published_at":69},"Dev Tools","dev-tools",96,"2026-10-01T16:57:03.000Z",{"name":71,"slug":72,"count":73,"latest_published_at":74},"Software","software",93,"2026-09-30T21:41:11.000Z",{"name":76,"slug":77,"count":78,"latest_published_at":79},"Startups","startups",90,"2026-10-01T21:55:22.000Z",{"name":81,"slug":82,"count":83,"latest_published_at":84},"Gaming","gaming",53,"2026-10-02T02:50:39.000Z",{"name":86,"slug":87,"count":88,"latest_published_at":89},"General","general",50,"2026-09-30T21:37:54.000Z",{"name":91,"slug":92,"count":93,"latest_published_at":94},"Reviews","reviews",31,"2026-09-28T14:31:34.000Z",{"name":96,"slug":97,"count":98,"latest_published_at":99},"How-To","how-to",7,"2026-10-01T09:00:00.000Z"]