[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-researchers-build-a-citation-checker-for-ai-legal-answers":10,"sections":40},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":35,"feedback":39,"feedback_at":22,"cost_usd":39,"total_tokens":39},6354,"researchers-build-a-citation-checker-for-ai-legal-answers","Researchers build a citation checker for AI legal answers","GANDR pairs a drafting AI with a critic that checks every citation against its source, catching fabricated legal references baseline models miss.","A new AI system checks its own legal citations before handing over an answer.\n\nResearchers built GANDR, a two-agent system for legal question answering. One model, called the Drafter, writes an answer in a structured legal-reasoning format. A second model, the Critic, gets the same view as a human verifier and checks each individual claim against the passage it cites, producing an audit trace after every round. The system also enforces a strict rule: a citation only counts if it resolves to a passage the retrieval system actually returned, not one that merely sounds plausible.\n\nOn a 185-question legal benchmark where all six tested systems shared the same underlying model and retrieval setup, GANDR reached 70.8% strict accuracy, beating the next-best system by 11.3 percentage points. Turning off the protocol-anchored commit rule, the part that locks in the Critic's verdict, dropped accuracy by 22.7 points, which suggests most of the gain comes from the verification step itself, not better writing. Checked against two law-trained annotators, the audit's flag for under-supported claims scored an F1 of 0.84.\n\nThe researchers are upfront about the limits: the system's more detailed four-way verdict labels only weakly matched what the human reviewers picked, and the code is listed as available upon request rather than published outright.","[\"ai\",\"legal-tech\",\"research\",\"hallucinations\"]","2026-09-11T04:00:00.000Z","2026-09-11T08:00:36.447Z","2026-09-11T08:00:48.375Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"Cut or attribute the claim that hallucinated citations are 'burning lawyers... real cases, wrong holdings attached' — it's asserted as established fact with no citation or specific incident, and nothing in the source material supports it.","resolved","ai",[30,32,33,34],"legal-tech","research","hallucinations",[36],{"name":37,"url":38},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2609.10293",0,{"sections":41},[42,45,49,53,58,63,68,71,76,80,85,90,95,100],{"name":43,"slug":30,"count":44,"latest_published_at":18},"AI",3543,{"name":46,"slug":47,"count":48,"latest_published_at":18},"Security","security",637,{"name":50,"slug":51,"count":52,"latest_published_at":18},"Policy","policy",338,{"name":54,"slug":55,"count":56,"latest_published_at":57},"Deals","deals",179,"2026-06-29T20:02:07.000Z",{"name":59,"slug":60,"count":61,"latest_published_at":62},"Hardware","hardware",153,"2026-09-09T15:12:32.000Z",{"name":64,"slug":65,"count":66,"latest_published_at":67},"Consumer Tech","consumer-tech",99,"2026-09-09T17:27:33.000Z",{"name":69,"slug":70,"count":66,"latest_published_at":18},"Science","science",{"name":72,"slug":73,"count":74,"latest_published_at":75},"Software","software",75,"2026-09-10T20:41:21.000Z",{"name":77,"slug":78,"count":79,"latest_published_at":18},"Dev Tools","dev-tools",70,{"name":81,"slug":82,"count":83,"latest_published_at":84},"Startups","startups",55,"2026-09-09T23:14:29.000Z",{"name":86,"slug":87,"count":88,"latest_published_at":89},"Gaming","gaming",43,"2026-09-10T12:18:06.000Z",{"name":91,"slug":92,"count":93,"latest_published_at":94},"General","general",41,"2026-09-08T01:57:23.000Z",{"name":96,"slug":97,"count":98,"latest_published_at":99},"Reviews","reviews",20,"2026-06-24T12:00:01.000Z",{"name":101,"slug":102,"count":103,"latest_published_at":104},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]