Research demo
Financial transaction hijacking with M365 Copilot as an insider (Zenity Black Hat red team)
AIR-2024-0029 AIR record · 2024-08-microsoft-copilot-financial-hijack
From the supporting source
“It's actually very difficult to create a [Copilot Studio] bot that is safe,” Bargury told The Register in an interview ahead of conference talks, “because all of the defaults are insecure.”theregister.com
The record
Disclosed
2024-08-08
Occurred
2024-08-08
Vendor
Microsoft
Product
Microsoft 365 Copilot
Risk domain
Agent behaviour › Unsafe actuation
Also touches
Confused deputy, Data and memory poisoning
System type
Generative model
Who acted
Agent acted — Copilot was driven to alter a real financial transaction
Attack surface
Enterprise assistant
Autonomy level
Assistant
Initial vector
Indirect prompt injection email
Impact type
Fraud, Integrity violation
Confidence
Medium
Submitted by
EAI Internal
Crosswalk
- OWASP Agentic Top 10 (2026)
- ASI01 – Agent Goal Hijack
- MITRE ATLAS
- AML.T0048 – External Harms
- NIST AI RMF
- MEASURE 2.6; MANAGE 1.3
- EU AI Act
- Annex III §1(c)
- ISO/IEC
- TR 24028; 24029-1; 23894
- AIUC-1
- C. Safety
- Scope
- agent misuse
- Mitigation
- Require confirmation for destructive actions; Implement dry-run modes; Use layered safety controls.
- Taxonomy
- Enkrypt AI agent risk taxonomy · Black-Box Red Teaming of Agentic AI: A Taxonomy-Driven Framework for Automated Risk Discovery
Blast radius
M365 Copilot tenants whose users act on Copilot-surfaced banking details
Capability abused
Defense & remediation
Recorded defense
Copilot enterprise search grounding
Guardrail kinds
Unknown
Guardrail outcome
Silent
Taxonomy & references
Curator notes
Michael Bargury / Zenity, Black Hat USA 2024. Primary Zenity artifacts are a video and X thread; The Register coverage used as the source of record. Related to but distinct from the LOLCopilot phishing demo (see 2024-08-microsoft-copilot-lolcopilot).
Supporting sources
Cite as
Enkrypt AI. "Financial transaction hijacking with M365 Copilot as an insider (Zenity Black Hat red team)". AIR, AIR-2024-0029. https://agentincident.vercel.app/i/AIR-2024-0029/ (accessed 2026-10-19).