Safety failure
Realized harm
Baidu Apollo Go robotaxi struck a pedestrian crossing against a red light in Wuhan as it pulled away on green
AIR-2024-0023 AIR record · 2024-07-baidu-apollo-go-wuhan-pedestrian-collision
A real party was affected. This incident caused actual consequences, not a demonstrated capability.
From the supporting source
The incident occurred as the autonomous vehicle started moving on a green light while the pedestrian was allegedly crossing against a red light.m.gmw.cn
The record
Disclosed
2024-07-10
Occurred
2024-07-07
Vendor
Baidu
Product
Apollo Go (萝卜快跑)
Risk domain
Agent behaviour › Unsafe actuation
System type
Classical autonomy (no generative model)
Who acted
Agent acted — the robotaxi struck the pedestrian as it pulled away
Attack surface
Autonomous operations
Autonomy level
Fully autonomous
Initial vector
None autonomous action
Impact type
Physical safety
Confidence
High
Submitted by
EAI Internal
Crosswalk
- OWASP Agentic Top 10 (2026)
- ASI01 – Agent Goal Hijack
- MITRE ATLAS
- AML.T0048 – External Harms
- NIST AI RMF
- MEASURE 2.6; MANAGE 1.3
- EU AI Act
- Annex III §1(c)
- ISO/IEC
- TR 24028; 24029-1; 23894
- AIUC-1
- C. Safety
- Scope
- agent misuse
- Mitigation
- Require confirmation for destructive actions; Implement dry-run modes; Use layered safety controls.
- Taxonomy
- Enkrypt AI agent risk taxonomy · Black-Box Red Teaming of Agentic AI: A Taxonomy-Driven Framework for Automated Risk Discovery
Blast radius
one pedestrian with minor injuries; Apollo Go operating in 11 Chinese cities at the time
Capability abused
Defense & remediation
Recorded defense
pedestrian detection
Guardrail kinds
Physical safety system
Guardrail outcome
Silent
Fix shipped
none disclosed; Baidu cooperated with local police
Taxonomy & references
Curator notes
Included as the corpus's non-US robotaxi datapoint. Chinese coverage centred on an unresolved question that applies to every autonomous agent: with no occupant, liability falls to the owner/operator, and Chinese policy had no unified allocation across L2-L4. Verified quote is from the AI Incident Database's own English summary because the underlying reporting is Chinese-language. AI Incident Database incident 821.
Supporting sources
Cite as
Enkrypt AI. "Baidu Apollo Go robotaxi struck a pedestrian crossing against a red light in Wuhan as it pulled away on green". AIR, AIR-2024-0023. https://agentincident.vercel.app/i/AIR-2024-0023/ (accessed 2026-10-19).