[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-seva-wants-to-fix-ai-fact-checking-from-the-inside-out":10,"sections":40},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":35,"feedback":39,"feedback_at":22,"cost_usd":39,"total_tokens":39},2719,"seva-wants-to-fix-ai-fact-checking-from-the-inside-out","SEVA Wants to Fix AI Fact-Checking From the Inside Out","A new verification agent uses structured rewards and a self-evolution loop to catch hallucinations — and matches GPT-4o-mini at a fraction of the size.","A research team has built a verification agent that does more than flag bad facts — it explains why they're wrong and suggests fixes.\n\nCurrent fact-attribution verifiers attached to large language models tend to spit out a binary pass\u002Ffail with no explanation, making it nearly impossible for downstream agents to self-correct or for operators to audit decisions. SEVA changes that by emitting structured output: evidence alignments, step-by-step reasoning, calibrated confidence scores, and a six-category error diagnosis. Training it with reinforcement learning required a custom fix — standard binary reward caused what the authors call \"advantage collapse,\" where gradient signals vanish entirely. Their solution was a process reward that breaks verification quality into five weighted components, restoring the training signal and letting the model learn behavior before outcomes.\n\nThe benchmark numbers are the interesting part. A SEVA-3B model matches GPT-4o-mini on the ClearFacts dataset (69.0 vs. 69.8 F1) while producing far more auditable output — a meaningful result if it holds outside controlled conditions. More surprising is what happened during a four-round self-evolution experiment on a 7B model: each round produced a benchmark specialist, not a generalist. The model gained 15 percentage points on HaluEval while losing 10 to 14 points on TruthfulQA in the same run, and the effect persisted even at four times the data volume.\n\nThat specialization finding is the paper's sharpest edge. The field has long debated whether small, task-specific models can reliably replace frontier-scale ones for verification work — SEVA's results suggest the answer is \"sometimes, for specific benchmarks,\" which is a more honest answer than most product launches will give you.","[\"ai\",\"hallucination\",\"fact-checking\",\"reinforcement-learning\"]","2026-06-30T04:00:00.000Z","2026-06-30T11:32:01.548Z","2026-06-30T11:32:04.474Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"The article describes SEVA's self-evolution loop as running on the 3B model, but the source states the four-round self-evolution experiment was conducted on a 7B model — correct this before publication.","resolved","ai",[30,32,33,34],"hallucination","fact-checking","reinforcement-learning",[36],{"name":37,"url":38},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2606.29713",0,{"sections":41},[42,46,51,56,61,66,71,76,81,86,91,95,100,105],{"name":43,"slug":30,"count":44,"latest_published_at":45},"AI",2590,"2026-07-16T04:00:00.000Z",{"name":47,"slug":48,"count":49,"latest_published_at":50},"Security","security",294,"2026-07-15T19:59:48.000Z",{"name":52,"slug":53,"count":54,"latest_published_at":55},"Deals","deals",179,"2026-06-29T20:02:07.000Z",{"name":57,"slug":58,"count":59,"latest_published_at":60},"Policy","policy",158,"2026-07-16T00:02:48.000Z",{"name":62,"slug":63,"count":64,"latest_published_at":65},"Hardware","hardware",122,"2026-07-14T19:46:26.000Z",{"name":67,"slug":68,"count":69,"latest_published_at":70},"Consumer Tech","consumer-tech",93,"2026-07-13T13:20:48.000Z",{"name":72,"slug":73,"count":74,"latest_published_at":75},"Software","software",70,"2026-07-13T19:52:25.000Z",{"name":77,"slug":78,"count":79,"latest_published_at":80},"Science","science",66,"2026-07-10T10:29:37.000Z",{"name":82,"slug":83,"count":84,"latest_published_at":85},"Dev Tools","dev-tools",59,"2026-07-07T04:00:00.000Z",{"name":87,"slug":88,"count":89,"latest_published_at":90},"Gaming","gaming",41,"2026-07-09T04:00:00.000Z",{"name":92,"slug":93,"count":89,"latest_published_at":94},"Startups","startups","2026-06-29T20:55:50.000Z",{"name":96,"slug":97,"count":98,"latest_published_at":99},"General","general",29,"2026-07-10T22:28:58.000Z",{"name":101,"slug":102,"count":103,"latest_published_at":104},"Reviews","reviews",20,"2026-06-24T12:00:01.000Z",{"name":106,"slug":107,"count":108,"latest_published_at":109},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]