US military averted conflict with China due to AI hallucination

a us military analyst queried an ai chatbot to synthesize open-source data with classified signals intelligence on a chinese vessel. the chatbot misidentified the ship's cargo manifest, and the analyst used the tool again to format the erroneous findings into an official-looking summary. the false intelligence report was circulated across command channels, prompting military aircraft to be deployed before the operation was aborted at the last minute. this incident underscores growing concerns among military officials and experts about the potential for ai errors to travel up the chain of command before being questioned. the us military is racing to integrate ai to accelerate decision-making, but this incident highlights the need for safeguards to prevent similar incidents.