Safety failure
Realized harm
Two men immobilised a Waymo by standing in front of it to demand the female passenger's phone number
AIR-2024-0042 AIR record · 2024-09-waymo-passenger-trapped-harassment
A real party was affected. This incident caused actual consequences, not a demonstrated capability.
From the supporting source
The 28-year-old, who asked to be identified as Amina V., said the Waymo was stopped at a red light last Saturday morning when a man stood in front of the car and refused to leave, forcing the car to stop.unilad.com
The record
Disclosed
2024-09-30
Occurred
2024-09-28
Vendor
Waymo (Alphabet)
Product
Waymo Driver
Risk domain
Agent behaviour › Unsafe actuation
Also touches
Bias and toxicity
System type
Classical autonomy (no generative model)
Who acted
Agent acted (contested) — the vehicle yielded and immobilised itself, trapping the passenger
Attack surface
Autonomous operations
Autonomy level
Fully autonomous
Initial vector
Physical adversarial blocking
Impact type
Physical safety, Harassment
Confidence
High
Submitted by
EAI Internal
Crosswalk
- OWASP Agentic Top 10 (2026)
- ASI01 – Agent Goal Hijack
- MITRE ATLAS
- AML.T0048 – External Harms
- NIST AI RMF
- MEASURE 2.6; MANAGE 1.3
- EU AI Act
- Annex III §1(c)
- ISO/IEC
- TR 24028; 24029-1; 23894
- AIUC-1
- C. Safety
- Scope
- agent misuse
- Mitigation
- Require confirmation for destructive actions; Implement dry-run modes; Use layered safety controls.
- Taxonomy
- Enkrypt AI agent risk taxonomy · Black-Box Red Teaming of Agentic AI: A Taxonomy-Driven Framework for Automated Risk Discovery
Blast radius
one passenger; the technique works against any pedestrian-yielding autonomous vehicle
Capability abused
Defense & remediation
Recorded defense
Rider Support line
Guardrail kinds
Unknown
Guardrail outcome
Silent
Fix shipped
unknown
Taxonomy & references
Curator notes
The agent's safety property is the attack. Yield-to-pedestrians is correct behaviour and also a zero-skill immobilisation primitive that a human driver would have overridden. Second instance of this pattern in the corpus after the February 2024 sensor-covering case, which is why it is recorded rather than folded in. AI Incident Database incident 854.
Supporting sources
Cite as
Enkrypt AI. "Two men immobilised a Waymo by standing in front of it to demand the female passenger's phone number". AIR, AIR-2024-0042. https://agentincident.vercel.app/i/AIR-2024-0042/ (accessed 2026-10-19).