[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-new-preprint-detects-ai-hallucinations-from-log-probs-alone":10,"sections":40},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":35,"feedback":39,"feedback_at":22,"cost_usd":39,"total_tokens":39},6695,"new-preprint-detects-ai-hallucinations-from-log-probs-alone","New Preprint Detects AI Hallucinations From Log-Probs Alone","A new arXiv preprint (2602.02888) introduces HALT, a tiny log-probability model for spotting LLM hallucinations, claiming gains over Lettuce.","A new preprint proposes catching AI hallucinations by watching a model's own confidence scores over time, instead of digging into its hidden layers.\n\nThe system, called HALT (Hallucination Assessment via Log-probs as Time series), is described in an arXiv preprint (arXiv:2602.02888, https:\u002F\u002Farxiv.org\u002Fabs\u002F2602.02888). It feeds only the top-20 token log-probabilities from a model's output into a small gated recurrent unit, treating those probabilities as a time series and adding entropy-based features on top. That sidesteps both common approaches: it doesn't need a model's internal weights or attention maps like white-box detectors do, and it doesn't read the generated text itself like black-box detectors do, so it can run against proprietary models available only through an API. The authors also built a companion benchmark, HUB, that folds ten task types - among them math, code generation, summarization, and world knowledge - into one evaluation suite.\n\nOn that benchmark, HALT beat Lettuce, a fine-tuned ModernBERT-based hallucination detector, while being 30 times smaller and running 60 times faster. The preprint does not report the accuracy margin behind that \"outperforms\" claim - only the size and speed numbers are quantified. That distinction matters for anyone weighing whether to trust it: a detector cheap enough to run on every generation is a different proposition from one proven to catch meaningfully more hallucinations.\n\nIt's also not peer-reviewed yet, and a comparison against a single rival encoder is a thin basis for \"outperforms\" until the accuracy numbers show up.","[\"ai\",\"hallucination-detection\",\"arxiv\",\"llm-evaluation\"]","2026-09-17T04:00:00.000Z","2026-09-18T06:31:26.524Z","2026-09-18T06:31:38.448Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"Attribute the findings explicitly to the arXiv preprint (with paper ID\u002Flink and preprint status) instead of anonymous 'researchers,' state the actual metric behind the 'outperformed' claim rather than just the speed multipliers, and drop the unsourced 'leading' descriptor for Lettuce in the dek.","resolved","ai",[30,32,33,34],"hallucination-detection","arxiv","llm-evaluation",[36],{"name":37,"url":38},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2602.02888",0,{"sections":41},[42,46,50,55,60,64,68,73,78,82,87,92,97,102],{"name":43,"slug":30,"count":44,"latest_published_at":45},"AI",3852,"2026-09-17T08:27:09.000Z",{"name":47,"slug":48,"count":49,"latest_published_at":18},"Security","security",648,{"name":51,"slug":52,"count":53,"latest_published_at":54},"Policy","policy",338,"2026-09-11T04:00:00.000Z",{"name":56,"slug":57,"count":58,"latest_published_at":59},"Deals","deals",179,"2026-06-29T20:02:07.000Z",{"name":61,"slug":62,"count":63,"latest_published_at":18},"Hardware","hardware",154,{"name":65,"slug":66,"count":67,"latest_published_at":18},"Science","science",114,{"name":69,"slug":70,"count":71,"latest_published_at":72},"Consumer Tech","consumer-tech",99,"2026-09-09T17:27:33.000Z",{"name":74,"slug":75,"count":76,"latest_published_at":77},"Software","software",75,"2026-09-10T20:41:21.000Z",{"name":79,"slug":80,"count":81,"latest_published_at":18},"Dev Tools","dev-tools",73,{"name":83,"slug":84,"count":85,"latest_published_at":86},"Startups","startups",55,"2026-09-09T23:14:29.000Z",{"name":88,"slug":89,"count":90,"latest_published_at":91},"Gaming","gaming",43,"2026-09-10T12:18:06.000Z",{"name":93,"slug":94,"count":95,"latest_published_at":96},"General","general",41,"2026-09-08T01:57:23.000Z",{"name":98,"slug":99,"count":100,"latest_published_at":101},"Reviews","reviews",20,"2026-06-24T12:00:01.000Z",{"name":103,"slug":104,"count":105,"latest_published_at":106},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]