[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-ai-agents-fail-when-users-dont-know-what-they-want":10,"sections":34},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":24,"tags":25,"sources":29,"feedback":33,"feedback_at":22,"cost_usd":33,"total_tokens":33},3005,"ai-agents-fail-when-users-dont-know-what-they-want","AI Agents Fail When Users Don't Know What They Want","A new benchmark finds frontier AI agents top out at 56% accuracy when users lack the domain knowledge to state clear preferences.","Current AI agents are bad at helping confused users figure out what they actually want.\n\nResearchers published a paper arguing that the standard assumption baked into most AI agents — that users arrive with well-formed preferences — is wrong. When a user doesn't know enough about a domain to specify what they want, asking clarifying questions doesn't help. The team formalized this gap using a framework called CoPref, which models how users build preferences through conversation rather than simply revealing ones they already hold. They then built CoShop, an interactive benchmark where an agent must converse with and make recommendations for a user who is still learning what they want.\n\nThe results are a quiet indictment of how frontier models handle ambiguity. None of the five models tested broke 56% accuracy on CoShop after five turns of conversation — not because they couldn't find relevant items, but because the interactions did almost nothing to expand users' understanding of their own needs. The failure mode is less \"agent can't search\" and more \"agent doesn't teach.\"\n\nThis reframes a debate that has mostly focused on retrieval quality and tool use. The harder problem may be pedagogical: can an agent recognize when a user needs education rather than clarification, and deliver it concisely enough to stay useful? Most current systems are not designed to do that, and this benchmark gives researchers a concrete way to measure the gap.","[\"ai\",\"agents\",\"benchmarks\",\"recommendations\"]","2026-07-01T04:00:00.000Z","2026-07-01T05:03:18.881Z","2026-07-01T05:03:21.821Z","published",null,[],"ai",[24,26,27,28],"agents","benchmarks","recommendations",[30],{"name":31,"url":32},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2606.30863",0,{"sections":35},[36,40,45,50,55,60,65,70,75,80,85,89,94,99],{"name":37,"slug":24,"count":38,"latest_published_at":39},"AI",2590,"2026-07-16T04:00:00.000Z",{"name":41,"slug":42,"count":43,"latest_published_at":44},"Security","security",294,"2026-07-15T19:59:48.000Z",{"name":46,"slug":47,"count":48,"latest_published_at":49},"Deals","deals",179,"2026-06-29T20:02:07.000Z",{"name":51,"slug":52,"count":53,"latest_published_at":54},"Policy","policy",158,"2026-07-16T00:02:48.000Z",{"name":56,"slug":57,"count":58,"latest_published_at":59},"Hardware","hardware",122,"2026-07-14T19:46:26.000Z",{"name":61,"slug":62,"count":63,"latest_published_at":64},"Consumer Tech","consumer-tech",93,"2026-07-13T13:20:48.000Z",{"name":66,"slug":67,"count":68,"latest_published_at":69},"Software","software",70,"2026-07-13T19:52:25.000Z",{"name":71,"slug":72,"count":73,"latest_published_at":74},"Science","science",66,"2026-07-10T10:29:37.000Z",{"name":76,"slug":77,"count":78,"latest_published_at":79},"Dev Tools","dev-tools",59,"2026-07-07T04:00:00.000Z",{"name":81,"slug":82,"count":83,"latest_published_at":84},"Gaming","gaming",41,"2026-07-09T04:00:00.000Z",{"name":86,"slug":87,"count":83,"latest_published_at":88},"Startups","startups","2026-06-29T20:55:50.000Z",{"name":90,"slug":91,"count":92,"latest_published_at":93},"General","general",29,"2026-07-10T22:28:58.000Z",{"name":95,"slug":96,"count":97,"latest_published_at":98},"Reviews","reviews",20,"2026-06-24T12:00:01.000Z",{"name":100,"slug":101,"count":102,"latest_published_at":103},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]