[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-a-new-test-catches-resellers-swapping-out-the-ai-model-you-paid-for":10,"sections":46},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":35,"tags":36,"sources":41,"feedback":45,"feedback_at":22,"cost_usd":45,"total_tokens":45},9314,"a-new-test-catches-resellers-swapping-out-the-ai-model-you-paid-for","A New Test Catches Resellers Swapping Out the AI Model You Paid For","KBF tests whether an API quietly swaps the LLM you were promised for a cheaper one, catching every known substitution in trials without false alarms.","A new audit tool can catch an API quietly swapping the AI model it promised you for a cheaper one.\n\nResearchers built KBF, a black-box auditing method that works by asking a model questions near the edge of what it knows, including ones it reliably gets wrong the same way every time. Those repeatable wrong answers act like a fingerprint. Across 16 production endpoints, the team ran 155 separate substitution attempts total, testing different swapped-in models and routing setups at each endpoint, and KBF flagged every single one. None of the 16 genuine same-model control checks triggered a false alarm. In mixed-routing simulations, it still hit a 95% detection rate even when only 15% of responses actually came from a swapped model.\n\nThe researchers then pointed KBF at the real world: auditing 28 live endpoints across six platforms. Seven came back statistically inconsistent with the model they claimed to be running.\n\nThis matters because the market for LLM access is full of middlemen: relays, resellers, and proxy APIs. Buyers have no reliable way to confirm they are getting the model they paid for, rather than a cheaper substitute routed in behind the scenes. KBF offers a receipt instead of blind trust: a repeatable check costing about $0.67 per audit, even when verifying against an expensive reference model like GPT-6 Astra.\n\nSeven out of 28 flagged endpoints is the real headline. That is not a hypothetical risk - it is roughly a quarter of tested real-world providers potentially not delivering what they advertise. Whether anyone acts on it is another matter. Right now this is a research paper, not a certification regime any reseller has agreed to submit to.","[\"llm-auditing\",\"ai-security\",\"api-resellers\",\"model-verification\"]","2026-10-01T04:00:00.000Z","2026-10-02T08:56:03.488Z","2026-10-02T08:56:04.350Z","published",null,[24,30],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"Drop or hedge the 'GPT-6 Astra' reference — there's no confirmed model by that name, so citing it as a concrete example of audit cost reads as an unverifiable\u002Finvented model name; replace with a generic phrasing like 'a top-tier flagship model' or verify the name before republishing.","resolved",{"id":31,"reviewer":32,"round":33,"reason":34,"status":29},"publisher-r2","publisher",2,"The body states KBF caught 155 of 155 substitution attempts across 16 production endpoints but never explains how 155 attempts map to only 16 endpoints, leaving a numerical inconsistency unresolved.","ai",[37,38,39,40],"llm-auditing","ai-security","api-resellers","model-verification",[42],{"name":43,"url":44},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2605.29524",0,{"sections":47},[48,51,55,59,64,69,73,78,83,87,92,97,102,107],{"name":49,"slug":35,"count":50,"latest_published_at":18},"AI",5690,{"name":52,"slug":53,"count":54,"latest_published_at":18},"Security","security",820,{"name":56,"slug":57,"count":58,"latest_published_at":18},"Policy","policy",430,{"name":60,"slug":61,"count":62,"latest_published_at":63},"Deals","deals",308,"2026-10-01T12:30:00.000Z",{"name":65,"slug":66,"count":67,"latest_published_at":68},"Hardware","hardware",196,"2026-09-30T13:00:00.000Z",{"name":70,"slug":71,"count":72,"latest_published_at":18},"Science","science",165,{"name":74,"slug":75,"count":76,"latest_published_at":77},"Consumer Tech","consumer-tech",150,"2026-10-01T11:59:27.000Z",{"name":79,"slug":80,"count":81,"latest_published_at":82},"Dev Tools","dev-tools",93,"2026-10-01T02:30:48.000Z",{"name":84,"slug":85,"count":81,"latest_published_at":86},"Software","software","2026-09-30T21:41:11.000Z",{"name":88,"slug":89,"count":90,"latest_published_at":91},"Startups","startups",84,"2026-09-30T20:39:09.000Z",{"name":93,"slug":94,"count":95,"latest_published_at":96},"Gaming","gaming",51,"2026-09-30T16:24:30.000Z",{"name":98,"slug":99,"count":100,"latest_published_at":101},"General","general",50,"2026-09-30T21:37:54.000Z",{"name":103,"slug":104,"count":105,"latest_published_at":106},"Reviews","reviews",31,"2026-09-28T14:31:34.000Z",{"name":108,"slug":109,"count":110,"latest_published_at":111},"How-To","how-to",7,"2026-10-01T09:00:00.000Z"]