[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-claude-fable-51-scored-60-on-api-94-in-app-after-a-fix":10,"sections":41},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":36,"feedback":40,"feedback_at":22,"cost_usd":40,"total_tokens":40},13093,"claude-fable-51-scored-60-on-api-94-in-app-after-a-fix","Claude Fable 5.1 Scored 60% on API, 94% in App After a Fix","Anthropic's guidance on building safety tests cites a 60% self-harm result for Claude Fable 5.1 via API and 94% in the app after a fix.","Anthropic has published guidance on building reliable AI safety tests, and its headline example is a gap: Claude Fable 5.1 behaved appropriately in 60% of self-harm test conversations through the API, against 94% in the Claude app after a fix.\n\nThe API is the route developers use to build their own products on top of the model. The app is Anthropic's own consumer product. The two numbers are 34 percentage points apart, but they are not a clean comparison. The 94% comes after a fix, so the difference mixes the access route with whatever was repaired. Anthropic's guidance, as described, does not say what the fix was.\n\nThe company also warned that many headline safety scores hide wide uncertainty. In plain terms, a single percentage can sit on top of a broad range of plausible results, depending on how the test was built and run.\n\nThat matters because safety scores usually travel as single numbers: in launch announcements, in comparisons between labs, in the tables readers skim. A figure like 60% or 94% looks precise, and it invites ranking. The guidance is a reminder that the useful questions come before the number: how many conversations were tested, how they were written, how appropriate behavior was judged, and how much the result moves when any of that changes.\n\nThe closest everyday comparison is polling. A poll that reports 52% with no margin of error is hard to interpret, and a safety score with no stated uncertainty has the same problem. The material available here does not say how many conversations Anthropic tested or how wide its uncertainty was, which is the detail that would make either figure easier to read.","[\"anthropic\",\"ai-safety\",\"evaluations\",\"claude\"]","2026-11-13T19:01:04.000Z","2026-11-14T08:03:36.760Z","2026-11-14T08:04:29.969Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"The headline and dek present 60% (API) versus 94% (app) as a setup effect, but the source says the 94% came after a fix, so the comparison is confounded and the body even concedes this; revise the headline and dek to say 'after a fix' and drop the claim that the numbers show the access route changes the score. Also remove the unsupported 'including its own' line implying Anthropic admitted to the habit, since the source says nothing about that.","resolved","ai",[32,33,34,35],"anthropic","ai-safety","evaluations","claude",[37],{"name":38,"url":39},"The Next Web","https:\u002F\u002Fthenextweb.com\u002Fnews\u002Fanthropic-safety-evaluations-guidance-fable-self-harm",0,{"sections":42},[43,47,52,57,62,67,71,76,81,86,91,95,100,105],{"name":44,"slug":30,"count":45,"latest_published_at":46},"AI",7159,"2026-11-13T23:00:00.000Z",{"name":48,"slug":49,"count":50,"latest_published_at":51},"Security","security",1138,"2026-11-13T19:26:07.000Z",{"name":53,"slug":54,"count":55,"latest_published_at":56},"Deals","deals",666,"2026-11-14T10:00:00.000Z",{"name":58,"slug":59,"count":60,"latest_published_at":61},"Policy","policy",625,"2026-11-13T22:46:47.000Z",{"name":63,"slug":64,"count":65,"latest_published_at":66},"Consumer Tech","consumer-tech",377,"2026-11-13T21:00:00.000Z",{"name":68,"slug":69,"count":70,"latest_published_at":66},"Hardware","hardware",341,{"name":72,"slug":73,"count":74,"latest_published_at":75},"Science","science",233,"2026-11-13T14:29:15.000Z",{"name":77,"slug":78,"count":79,"latest_published_at":80},"Software","software",177,"2026-11-14T08:54:55.000Z",{"name":82,"slug":83,"count":84,"latest_published_at":85},"Startups","startups",162,"2026-11-13T17:32:35.000Z",{"name":87,"slug":88,"count":89,"latest_published_at":90},"Dev Tools","dev-tools",127,"2026-11-11T19:00:44.000Z",{"name":92,"slug":93,"count":89,"latest_published_at":94},"General","general","2026-11-14T07:26:44.000Z",{"name":96,"slug":97,"count":98,"latest_published_at":99},"Gaming","gaming",111,"2026-11-14T08:00:00.000Z",{"name":101,"slug":102,"count":103,"latest_published_at":104},"Reviews","reviews",38,"2026-10-20T12:00:00.000Z",{"name":106,"slug":107,"count":108,"latest_published_at":109},"How-To","how-to",8,"2026-10-05T09:00:00.000Z"]