[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-weighted-rules-beat-llms-at-their-own-reasoning-game":10,"sections":44},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":34,"tags":35,"sources":39,"feedback":43,"feedback_at":22,"cost_usd":43,"total_tokens":43},4050,"weighted-rules-beat-llms-at-their-own-reasoning-game","Weighted Rules Beat LLMs at Their Own Reasoning Game","A new framework finds that applying learned probabilistic rules directly outperforms feeding those rules back into an LLM — and the gap is not small.","Research into how to make language models reason more reliably just got a concrete data point — and it cuts against a common assumption.\n\nA team of researchers built RLIE, a four-stage framework that uses an LLM to propose and filter candidate rules in plain language, then hands those rules to logistic regression to assign probabilistic weights. The system iteratively updates the rule set by learning from prediction errors. The key test: does it work better to apply those weighted rules directly as a classifier, or to pump them back into an LLM as a prompt? The answer was direct application — by a meaningful margin. Feeding the rules, weights, and model outputs back into an LLM actually *degraded* accuracy.\n\nThat finding matters because a lot of LLM-adjacent tooling assumes the model is the right place to do final integration — chain-of-thought, tool outputs, retrieved context all get stuffed into the prompt and the LLM is trusted to synthesize. RLIE's results suggest that when the task is precise probabilistic combination, that trust is misplaced. Classic statistical methods, paired with LLM-generated rules, outperform the LLM acting as both generator and integrator.\n\nThe framing here — LLMs are good at semantic generation, unreliable at probabilistic arithmetic — is not new, but this is a controlled demonstration of the gap rather than a theoretical argument. Worth keeping in mind the next time a vendor pitches a reasoning pipeline where the model does everything.","[\"ai\",\"machine-learning\",\"llm\",\"research\"]","2026-07-07T04:00:00.000Z","2026-07-07T15:51:23.277Z","2026-07-07T15:51:26.072Z","published",null,[24,30],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"The dek and body claim the logistic regression dates to 1958, but logistic regression as a formalized statistical method was developed in the 1940s–50s and that specific date is not in the source material — remove or verify the claim before publication.","resolved",{"id":31,"reviewer":26,"round":32,"reason":33,"status":29},"editor-r2",2,"The dek describes RLIE as 'a new framework' and 'probabilistic weighting' without specifying what it fixes or for whom — it reads as a vague placeholder; rewrite the dek to lead with the concrete finding (that using weighted rules directly outperforms feeding them back into an LLM) so the actual news is in the first line.","ai",[34,36,37,38],"machine-learning","llm","research",[40],{"name":41,"url":42},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2510.19698",0,{"sections":45},[46,50,55,60,65,70,75,80,85,89,94,98,103,108],{"name":47,"slug":34,"count":48,"latest_published_at":49},"AI",2590,"2026-07-16T04:00:00.000Z",{"name":51,"slug":52,"count":53,"latest_published_at":54},"Security","security",294,"2026-07-15T19:59:48.000Z",{"name":56,"slug":57,"count":58,"latest_published_at":59},"Deals","deals",179,"2026-06-29T20:02:07.000Z",{"name":61,"slug":62,"count":63,"latest_published_at":64},"Policy","policy",158,"2026-07-16T00:02:48.000Z",{"name":66,"slug":67,"count":68,"latest_published_at":69},"Hardware","hardware",122,"2026-07-14T19:46:26.000Z",{"name":71,"slug":72,"count":73,"latest_published_at":74},"Consumer Tech","consumer-tech",93,"2026-07-13T13:20:48.000Z",{"name":76,"slug":77,"count":78,"latest_published_at":79},"Software","software",70,"2026-07-13T19:52:25.000Z",{"name":81,"slug":82,"count":83,"latest_published_at":84},"Science","science",66,"2026-07-10T10:29:37.000Z",{"name":86,"slug":87,"count":88,"latest_published_at":18},"Dev Tools","dev-tools",59,{"name":90,"slug":91,"count":92,"latest_published_at":93},"Gaming","gaming",41,"2026-07-09T04:00:00.000Z",{"name":95,"slug":96,"count":92,"latest_published_at":97},"Startups","startups","2026-06-29T20:55:50.000Z",{"name":99,"slug":100,"count":101,"latest_published_at":102},"General","general",29,"2026-07-10T22:28:58.000Z",{"name":104,"slug":105,"count":106,"latest_published_at":107},"Reviews","reviews",20,"2026-06-24T12:00:01.000Z",{"name":109,"slug":110,"count":111,"latest_published_at":112},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]