A hallucinating AI chatbot nearly got a Chinese cargo ship boarded by the US military.
A US Special Operations Command analyst used an AI chatbot to help draft an intelligence report, and the chatbot misidentified cargo aboard a Chinese ship as components for a nuclear arms program, according to CNN, which cited four sources familiar with the episode. The assessment was entirely false. The US military began preparing to intercept and board the vessel in the Middle East, with air support on standby, before officials discovered the chatbot's error and called off the operation.
This is not an abstract worry about AI risk. It is a documented case where a chatbot's hallucination nearly triggered a military confrontation with a nuclear-armed power, with one source telling CNN the episode almost started a war. It also confirms AI tools are now embedded deep enough in intelligence workflows that their mistakes can shape operational decisions, not just produce awkward chatbot transcripts.
Every AI failure story this year carries the same moral: verify before you act. This time, someone did, just barely.