Safety failure
A US special-operations analyst's AI chatbot fused open-source and signals intelligence into a false report that a Chinese ship carried nuclear-weapons components; interception aircraft were airborne before the report was rechecked and the operation called off
AIR-2026-0251 AIR record · 2026-09-us-military-chatbot-false-chinese-ship-cargo-report
From the supporting source
The bot fused together open-source intelligence with secret signals intelligence in government holdings and reached its fateful conclusion about the material the ship was carrying.edition.cnn.com
The record
Disclosed
2026-09-18
Vendor
Unknown
Product
Unidentified AI chatbot used by US Special Operations Command Pacific analysts (commercial or government product not established)
Risk domain
Agent output quality › Hallucination
System type
Generative model
Who acted
Human acted on output — analysts acted on the chatbot's fused report; the system took no action itself
Attack surface
Enterprise assistant
Autonomy level
Assistant
Initial vector
Model hallucination
Impact type
False intelligence, Near miss military escalation
Confidence
Medium
Submitted by
EAI Internal
Crosswalk
- OWASP Agentic Top 10 (2026)
- ASI08 – Cascading Failures
- MITRE ATLAS
- AML.T0062 – Discover LLM Hallucinations
- NIST AI RMF
- MEASURE 2.5
- EU AI Act
- —
- ISO/IEC
- TR 24028; 24029-1
- AIUC-1
- D. Reliability
- Scope
- agent failure
- Mitigation
- Implement fact-checking via knowledge base/RAG; Tune model temperature/top-p.
- Taxonomy
- Enkrypt AI agent risk taxonomy · Black-Box Red Teaming of Agentic AI: A Taxonomy-Driven Framework for Automated Risk Discovery
Blast radius
one Chinese vessel and its crew targeted for interception; US military assets mobilised; operation aborted before contact
Capability abused
Defense & remediation
Recorded defense
human review of the intelligence report before the operation
Guardrail kinds
Unknown
Guardrail outcome
Silent
Fix shipped
none disclosed; sources say there is no single standard for verifying AI-generated intelligence across the military
Taxonomy & references
Curator notes
Scope test applied: admitted as a human-acted-on-output event because the consequential output depended on agent-specific retrieval - CNN reports the bot fused OSINT with signals intelligence 'in government holdings' (retrieval over classified stores), and the analyst then used AI again to package the result into a standard intelligence report that was disseminated. A consequential action followed (interception planned, armed personnel preparing to board, military aircraft airborne) and was called off only when officials rechecked the report. impact_realized false: the operation was aborted before any contact, so no party suffered a realized consequence; a source's 'almost started a war' is recorded as a near miss. CNN exclusive (18 Sep 2026) based on four anonymous sources; the chatbot is not identified and it is 'not clear whether the chatbot was a commercially available one or a US government product'; exact date undisclosed ('this spring', during the war with Iran); SOCPAC and the Pentagon did not respond. Single anonymous-sourced press account, hence medium. AI Incident Database incident 1701.
Supporting sources
Cite as
Enkrypt AI. "A US special-operations analyst's AI chatbot fused open-source and signals intelligence into a false report that a Chinese ship carried nuclear-weapons components; interception aircraft were airborne before the report was rechecked and the operation called off". AIR, AIR-2026-0251. https://agentincident.vercel.app/i/AIR-2026-0251/ (accessed 2026-10-19).