[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-a-geometry-fix-for-bayesian-optimizations-vanishing-gradients":10,"sections":35},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":24,"tags":25,"sources":30,"feedback":34,"feedback_at":22,"cost_usd":34,"total_tokens":34},8045,"a-geometry-fix-for-bayesian-optimizations-vanishing-gradients","A Geometry Fix for Bayesian Optimization's Vanishing Gradients","Researchers use Fisher information geometry to explain vanishing gradients in high-dimensional Bayesian optimization, proposing a trust-region fix called FITR.","A new paper diagnoses why Bayesian optimization slows to a crawl in high dimensions - and offers a geometric fix.\n\nResearchers examined Bayesian optimization through information geometry, pulling the Fisher information metric back through the surrogate model's posterior map. This produces a local sensitivity tensor over the input space that bounds the gradient of common acquisition functions, explaining the vanishing-gradient problem that plagues high-dimensional BO. The framework also unifies two existing heuristics, RAASP and dimension-scaled lengthscales, showing they are really the same trick viewed from different angles. From that foundation, the authors built FITR, a trust-region BO method that swaps lengthscale-based scaling for local pullback-Fisher weights.\n\nBO is the standard tool for tuning hyperparameters and other expensive-to-evaluate systems, and it has long been known to stall past a few dozen dimensions. Explaining that failure geometrically, rather than patching it with another heuristic, gives practitioners a principled reason to trust - or distrust - their scaling choices. It also frees BO from a GP-kernel straitjacket: FITR does not require an explicit lengthscale, so it can extend to non-isotropic surrogates.\n\nOn standard GP benchmarks with a squared-exponential kernel, FITR performs competitively, though the paper is candid that gains outside that setting are task-dependent - not the kind of caveat you get in a launch post dressed up as a breakthrough.","[\"bayesian-optimization\",\"information-geometry\",\"gaussian-processes\",\"machine-learning\"]","2026-09-28T04:00:00.000Z","2026-09-28T07:14:31.020Z","2026-09-28T07:14:37.718Z","published",null,[],"ai",[26,27,28,29],"bayesian-optimization","information-geometry","gaussian-processes","machine-learning",[31],{"name":32,"url":33},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2609.31107",0,{"sections":36},[37,40,44,49,54,59,63,68,73,78,83,88,92,97],{"name":38,"slug":24,"count":39,"latest_published_at":18},"AI",4689,{"name":41,"slug":42,"count":43,"latest_published_at":18},"Security","security",758,{"name":45,"slug":46,"count":47,"latest_published_at":48},"Policy","policy",399,"2026-09-27T18:39:02.000Z",{"name":50,"slug":51,"count":52,"latest_published_at":53},"Deals","deals",261,"2026-09-27T15:30:35.000Z",{"name":55,"slug":56,"count":57,"latest_published_at":58},"Hardware","hardware",188,"2026-09-27T20:46:36.000Z",{"name":60,"slug":61,"count":62,"latest_published_at":18},"Science","science",148,{"name":64,"slug":65,"count":66,"latest_published_at":67},"Consumer Tech","consumer-tech",135,"2026-09-26T14:30:00.000Z",{"name":69,"slug":70,"count":71,"latest_published_at":72},"Software","software",91,"2026-09-25T20:55:00.000Z",{"name":74,"slug":75,"count":76,"latest_published_at":77},"Dev Tools","dev-tools",84,"2026-09-26T04:20:58.000Z",{"name":79,"slug":80,"count":81,"latest_published_at":82},"Startups","startups",76,"2026-09-25T18:33:59.000Z",{"name":84,"slug":85,"count":86,"latest_published_at":87},"Gaming","gaming",48,"2026-09-25T18:35:21.000Z",{"name":89,"slug":90,"count":86,"latest_published_at":91},"General","general","2026-09-26T17:02:42.000Z",{"name":93,"slug":94,"count":95,"latest_published_at":96},"Reviews","reviews",30,"2026-09-24T20:07:31.000Z",{"name":98,"slug":99,"count":100,"latest_published_at":101},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]