[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-neural-net-ties-rivals-loses-to-classical-math-on-unseen-functions":10,"sections":36},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":34,"feedback":35,"feedback_at":22,"cost_usd":35,"total_tokens":35},10718,"neural-net-ties-rivals-loses-to-classical-math-on-unseen-functions","Neural Net Ties Rivals, Loses to Classical Math on Unseen Functions","A neural minimizer ties its deep-learning rivals on familiar functions but loses to a classical Gaussian-process estimator on unfamiliar ones.","Researchers built a neural network that can guess, in one shot, where a noisy function hits its lowest point - and it only does that well on problems that look like its training data.\n\nThe paper pits the Neural Function Minimizer (NFM), an iterative model that walks across the domain reading all twenty noisy samples at each step, against two Set Transformers of identical size - one that names a single point, one that returns a mixture of candidates - plus classical zero-query estimators. On held-out cases drawn from the same training families, all three learned models tie on accuracy and each beats every classical method; the NFM edges out a Gaussian-process posterior by 1.3 points of the domain and gives better-calibrated uncertainty than its Set Transformer rivals. Flip to functions outside those training families, though, and the ranking reverses: the classical Gaussian process becomes the most accurate estimator of the bunch, and it along with the mixture model racks up lower regret than the NFM.\n\nThat split matters more than either headline result. It suggests these learned minimizers aren't discovering some general trick for localizing minima - they're pattern-matching to the shapes they saw during training, and a decades-old statistical method still wins once the shapes change. The paper's other finding reinforces that: whether an estimator hedges between two equally deep valleys or commits to one isn't about neural versus classical architecture at all, it's about whether the estimator's output format names a single point or a mode.\n\nSo file this under promising, not proven. A neural net that matches specialized architectures in-distribution is a fine engineering result. One that loses to classical math the moment the data strays off-script is a reminder that benchmarks built from training-like holdouts can flatter learned models more than real-world robustness would.","[\"ai\",\"machine-learning\",\"research\"]","2026-10-08T04:00:00.000Z","2026-10-09T06:46:36.539Z","2026-10-09T06:46:42.301Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"Headline and dek oversell a clean neural-net win ('learns to guess,' 'out-guess classical math') while the body's actual finding is a split decision — ties with other neural nets in-distribution but losing to the classical Gaussian-process estimator on unfamiliar functions — so rewrite the headline\u002Fdek to reflect that mixed, more skeptical result rather than a one-sided success framing.","resolved","ai",[30,32,33],"machine-learning","research",[],0,{"sections":37},[38,42,47,52,57,62,67,72,77,81,86,91,96,101],{"name":39,"slug":30,"count":40,"latest_published_at":41},"AI",6518,"2026-10-08T11:00:00.000Z",{"name":43,"slug":44,"count":45,"latest_published_at":46},"Security","security",912,"2026-10-08T10:30:00.000Z",{"name":48,"slug":49,"count":50,"latest_published_at":51},"Policy","policy",475,"2026-10-08T14:04:42.000Z",{"name":53,"slug":54,"count":55,"latest_published_at":56},"Deals","deals",461,"2026-10-08T10:22:14.000Z",{"name":58,"slug":59,"count":60,"latest_published_at":61},"Hardware","hardware",223,"2026-10-08T08:30:04.000Z",{"name":63,"slug":64,"count":65,"latest_published_at":66},"Science","science",187,"2026-10-07T04:00:00.000Z",{"name":68,"slug":69,"count":70,"latest_published_at":71},"Consumer Tech","consumer-tech",175,"2026-10-08T09:16:05.000Z",{"name":73,"slug":74,"count":75,"latest_published_at":76},"Software","software",113,"2026-10-07T18:10:00.000Z",{"name":78,"slug":79,"count":75,"latest_published_at":80},"Startups","startups","2026-10-07T23:36:57.000Z",{"name":82,"slug":83,"count":84,"latest_published_at":85},"Dev Tools","dev-tools",105,"2026-10-07T16:59:11.000Z",{"name":87,"slug":88,"count":89,"latest_published_at":90},"General","general",61,"2026-10-07T22:00:24.000Z",{"name":92,"slug":93,"count":94,"latest_published_at":95},"Gaming","gaming",56,"2026-10-07T12:00:00.000Z",{"name":97,"slug":98,"count":99,"latest_published_at":100},"Reviews","reviews",33,"2026-10-05T11:57:17.000Z",{"name":102,"slug":103,"count":104,"latest_published_at":105},"How-To","how-to",8,"2026-10-05T09:00:00.000Z"]