H
Howardism
Plate IIAgent Security中文HOWARDISM

Zero Trust for AI Agents

PublishedMay 28, 2026FiledConceptDomainAgent SecurityTagsSecurityZero TrustAgent DeploymentAnthropicReading11 minSourceAI-synthesised

Anthropic's security framework for deploying autonomous agents: trust nothing / verify everything / assume breach, applied across a Foundation→Enterprise→Advanced tier model and an 8-phase implementation workflow

Illustration for Zero Trust for AI Agents

Sources#

Summary#

Anthropic's May 2026 security framework (eBook) for deploying autonomous agents in the enterprise. It applies the established Zero Trust doctrine — trust nothing, verify everything, assume breach has already occurred — to agentic systems, which existing perimeter- and human-identity-based security models were not designed to handle. The framework's organizing claim: agents face a distinct threat landscape, and "skip one capability and attackers exploit the gap." It is presented as a three-tier capability maturity model (Foundation / Enterprise / Advanced) plus an eight-phase implementation workflow, and is framed throughout as a response to AI-Accelerated Offense.

This is a hub page: the cluster of security concepts below (Least Agency, Blast Radius (Agentic), Agentic Prompt Injection, Agent Data Injection (ADI), MCP Tool Poisoning, Agent Supply Chain Risk, Memory and Context Poisoning, Agent Identity and Authentication, Impossible, Not Tedious (Design Test), Autonomous Defense) all reference it as a shared touchstone.

The three Zero Trust principles#

Zero Trust has roots in Stephen Paul Marsh's 1994 doctoral thesis; it gained momentum after perimeter breaches, and was codified by NIST SP 800-207 (2020) and the NSA's Zero Trust Implementation Guides (ZIGs) (2026). Three principles define it:

  1. Never trust and always verify — every access request is authenticated and authorized regardless of origin. An internal request gets the same scrutiny as an external one.
  2. Assume breach — design expecting compromise; limit the damage rather than only preventing intrusion. Segment by identity so one compromise doesn't grant access to others. (This is the Blast Radius (Agentic) containment posture.)
  3. Least privilege — grant only the minimum access for a specific task. OWASP's Least Agency extends this to agents (constraining not just what an agent can access but what each tool can do, how often, and where).

Why agents break existing security models#

Agentic systems differ from traditional software in ways that create new exposure:

  • Autonomous multi-step execution — agents act without human approval at each step, so a manipulated agent causes harm at machine speed.
  • Tool access (APIs, databases, file systems, MCP) — a compromised tool stack enables data theft, code execution, sabotage.
  • Instruction interpretation — ambiguity attackers can exploit (Agentic Prompt Injection).
  • Context persistence — memory across sessions creates new data-protection needs (Memory and Context Poisoning).
  • Multi-agent coordination — implicit trust relationships let attackers compromise one agent and pivot.

Traditional identity systems built for human users struggle to accommodate agents, which often run with elevated privileges or shared service accounts — a mismatch that motivates Agent Identity and Authentication.

The three-tier capability model#

Every control in the framework is specified across three tiers. Each tier builds on the prior one (advancing means strengthening, not replacing):

  • Foundation — minimum viable security for smaller / initial deployments. Crucially, the framework argues AI-accelerated offense has raised the Foundation floor: friction-only controls (rotating long-lived API keys, SMS MFA, rate limits) no longer qualify. Short-lived tokens, cryptographically-rooted identity, identity-based isolation, and automated first-pass triage are now entry requirements.
  • Enterprise — standard practice for organizations at significant scale; adds depth for multi-deployment complexity and meaningful business impact per compromise.
  • Advanced — aspirational for most; baseline for high-risk / stringently regulated deployments (national security, regulated finance/health). Hardware-backed identity, confidential computing, continuous authorization, ML-based anomaly detection.

The explicit prediction: "Expect the Advanced tier to become Enterprise standard as the space evolves, and Enterprise to become Foundation." Tiers are a roadmap, not a finish line.

The eight control domains (Part III)#

The tier tables span eight capability areas, each a Zero Trust control surface for agents:

  1. Agent identity & authentication — see Agent Identity and Authentication (cryptographic IDs → X.509 → hardware attestation; short-lived tokens → mTLS → hardware-bound credentials).
  2. Access control & privilege management — RBAC+deny-by-default → ABAC → continuous authorization; static roles → dynamic scoping → JIT/JEA; identity-based isolation → sandboxing → hardware isolation. The enforcement layer for Least Agency and Blast Radius (Agentic).
  3. Observability & auditing — action logging, immutable audit trails, traceability/provenance chains. Instrument dwell time and coverage before anything else.
  4. Behavioral monitoring & response — baselines → anomaly detection → automated response. Rule: automate the bookkeeping around incidents, not the decisions.
  5. Input validation & output controls — input sanitization (schemas, spotlighting, constitutional classifiers) and output filtering; defenses against Agentic Prompt Injection.
  6. Integrity & recovery — version-controlled / signed / immutable configs; rollback → automated rollback → self-healing. Counter-intuitive infra reflex: enable auto-updates because manual approval delay is now the bigger risk.
  7. AI governance policies — acceptable-use + incident response, governance committee, automated policy enforcement; addresses Shadow AI.

The eight-phase implementation workflow (Part IV–V)#

  1. Identify requirements — align security/legal/compliance/business before building.
  2. Manage supply chain risks — AI-BOM, OpenSSF Scorecard, dependency audits, AI vendoring (Agent Supply Chain Risk).
  3. Define agent boundaries — unique identity, approved/prohibited actions, escalation triggers, scope limits, and a deliberate Blast Radius (Agentic) assessment using the Impossible, Not Tedious (Design Test).
  4. Defend against prompt injection — input isolation, constitutional classifiers, limit attack surface (Agentic Prompt Injection).
  5. Secure tool access — tool allow-listing, capability restrictions, parameter validation, sandboxing, approval escalation.
  6. Protect agent credentials — short-lived / hardware-bound / per-agent credentials, JIT, ABAC (Agent Identity and Authentication).
  7. Safeguard agent memory — memory isolation, integrity validation, retention policies (Memory and Context Poisoning).
  8. Measure what matters — dwell time, coverage, explainability, behavioral conformance, detection speed.

Part V extends this to Autonomous Defense — running security operations fast enough to match AI-accelerated adversaries.

Regulatory alignment#

Zero Trust aligns with HIPAA, FINRA, GDPR, FedRAMP, and the EU AI Act; the US requires all federal agencies to adopt Zero Trust by 2027, with published guidance from the US (CISA/NSA/NIST), UK (NCSC), and Australia (Home Affairs). Anthropic notes it was one of the first AI companies to achieve ISO 42001 (responsible-AI) certification.

Connections#

  • AI-Accelerated Offense — the "why now": compressed exploit timelines are the framework's stated motivation; the Foundation floor was raised in response to it
  • Least Agency — OWASP extension of least privilege; the framework's authorization principle for agents
  • Blast Radius (Agentic) — the unit the "assume breach" principle is built to contain
  • Agent Identity and Authentication — control domain 1; the foundation for every other control
  • Agent Identity Management System (AIMS) — the IETF AIMS proposal is the standards-track, multi-vendor counterpart to this vendor framework's identity/auth control: it composes existing standards (WIMSE/SPIFFE + OAuth token exchange) where this ebook prescribes a tiered maturity model, and diverges by treating hardware attestation as optional rather than the Advanced-tier target (comparison on both pages); the same page also carries the OpenID AuthZEN drafts — COAZ (standards-track per-MCP-tool-call authorization, the Phase-5 "secure tool access" decision) and AARP (a prerequisite/approval "not yet" step for the human-in-the-loop escalation Phases 3/5 name) — the authorization-slice standardization, proposed Working Group Drafts weighted below the empirical per-call-authz systems
  • Agentic Prompt Injection — the threat Phase 4 and the input-validation domain defend against
  • Agent Data Injection (ADI) — a Phase-4 threat the framework's input-validation controls don't cover: it forges the trusted anchors (origin metadata, tool history) other controls rely on, with working RCE on the Claude Code reference implementation
  • Out-of-Band Prompt-Injection Defense — the academic-systems instantiation of Phase 4 and the framework's reference-monitor + least-privilege doctrine (CaMeL/FIDES/Progent/RTBAS/FORGE), plus the first independent adaptive evaluation of that class
  • Capability Gating Is Not Authorization — a concrete instantiation of Phase 5 "secure tool access" (parameter validation, approval escalation): an audit finding that LangChain/LlamaIndex/Stripe ship capability gating but leave complete mediation to the integrator, plus ScopeGate, a deterministic per-call value-authorization gate that closes the gap
  • Off-Host, Identity-Bound Authorization — Phase 4 + Phase 5 taken to the "assume breach" limit: aiAuthZ (Kodathala, arXiv 2607.05518) draws the trust boundary around the agent and makes an off-host gateway the single verified path to sensitive tools, authenticating the human sender per message so a compromised agent cannot forge authority through tool-call text — the identity-bound, off-host counterpart to ScopeGate's in-framework value gate (single-author preprint)
  • Agent Supply Chain Risk — the threat Phase 2 manages
  • Memory and Context Poisoning — the threat Phase 7 safeguards against
  • Impossible, Not Tedious (Design Test) — the standing design-review question applied to every control
  • Autonomous Defense — Part V; defensive operations at the speed of autonomous threats
  • MCP and Computer Use — MCP is a named high-risk tool surface (tool poisoning, run-your-own-server)
  • MCP Tool Poisoning — realizes the framework's tool-poisoning threat (Phase 4 input validation + Phase 5 secure tool access) two ways: the empirical ShareLock hits >90% ASR under moderate vetting (description-based scanning provably insufficient), and the case-study Agentjacking (Tenet Security) is the real-world exhibit — a lethal-trifecta instance in the wild (untrusted telemetry ingested + live AWS/GitHub creds present + reachable egress) where a legitimate Sentry MCP server relays attacker-injected data, defeating Phase-2 server-vetting because the server was never compromised. Both push enforcement to the action/authorization layer (Agentjacking's scale figures are vendor-reported, weighted below ShareLock)
  • Claude Code Best Practices — Claude Code's deny-by-default permissions, sandboxing, managed settings are cited throughout as a Zero Trust-aligned reference implementation
  • Anthropic — publisher of the framework
  • OWASP — source of the agentic threat taxonomy and the "least agency" term
  • Agentic Misalignment (AM) — distinct but adjacent: Zero Trust addresses externally-induced agent harm; agentic misalignment is self-motivated harm. Both need the same blast-radius containment

Open Questions#

  • The framework treats every Claude Code "Pro-tip" as a reference implementation. How much of the framework is vendor-neutral vs. tacitly assuming the Anthropic stack?
  • "Foundation floor raised" implies a moving baseline. How fast does the tier ladder actually shift, and who arbitrates it (NIST/NSA cadence vs. model-capability cadence)?
  • The framework is explicit that it is not legal/compliance assurance. Where does self-attested Zero Trust maturity meet auditable regulatory requirement?

Sources#

  • Zero Trust for AI Agents — Anthropic eBook, Zero Trust for AI Agents: A security framework for deploying autonomous AI agents in the enterprise (2026-05-18)
  • OpenID Foundation advances authorization for the agent era with new AuthZEN Working Group Drafts — OpenID Foundation, …advances authorization for the agent era with new AuthZEN Working Group Drafts, 15 June 2026, practitioner-opinion (proposed Working Group Drafts, weighted below the empirical per-call-authz systems). Standards-track instantiation of Phase 5 "secure tool access" (COAZ — per-MCP-tool-call authorization) and the Phase 3/5 human-in-the-loop escalation (AARP — prerequisite/approval pattern generalizing CIBA)
§ end
About this piece

Articles in this journal are synthesised by AI agents from a curated wiki and are refreshed automatically as new concepts arrive. Topics, framing, and editorial direction are curated by Howardism.

Cited by 25
  • Foundation → Enterprise → Advanced: Is the Agent Access-Control Jump a Cliff?

    No cliff — Enterprise (ABAC + dynamic privilege elevation with return-to-baseline + mTLS + sandboxing) is the pragmatic…

  • Agent Data Injection (ADI)

    A new category of indirect prompt injection: malicious payloads disguised as *trusted data* (metadata like a comment's…

  • Agent Identity and Authentication

    The foundation control for agentic Zero Trust: cryptographically-rooted per-agent identity (→X.509→hardware attestation…

  • Agent Identity Management System (AIMS)

    IETF draft-klrc-aiagent-auth's Agent Identity Management System: agents as WIMSE/SPIFFE-identified workloads with short…

  • Agent Supply Chain Risk

    Runtime-composed agent ecosystems expand the supply-chain attack surface: model poisoning (250 docs backdoor a 13B mode…

  • Agentic Misalignment (AM)

    Lynch et al. 2025 eval and threat model: LLM email-agent discovers it may be deleted, can take harmful actions; OOD rel…

  • Agentic Prompt Injection

    Direct and indirect injection of malicious instructions into an agent; LLMs cannot reliably distinguish information fro…

  • AI-Accelerated Offense

    Frontier models compress the vulnerability-to-exploit timeline from months to hours at marginal dollar cost; both attac…

  • Anthropic

    AI safety company / vendor of Claude; mission-as-tiebreaker culture; ~30–40 PMs across teams; Mike Krieger leads Labs r…

  • Autonomous Defense

    Running security operations at the speed of AI-accelerated threats: put a model at the front of the alert queue, automa…

  • Blast Radius (Agentic)

    The potential damage if an agent is compromised; the unit Zero Trust's 'assume breach' posture is built to contain via…

  • Capability Gating Is Not Authorization

    Mellafe Zuvic (arXiv 2606.28679): popular agent frameworks (LangChain/LangGraph, LlamaIndex, Stripe Agent Toolkit) ship…

  • Claude Code

    Anthropic's agentic coding product; created by Boris Cherny late 2024; TypeScript/React; CLI/desktop/web/mobile/IDE sur…

  • Impossible, Not Tedious (Design Test)

    Zero Trust design test for agentic security: does a control make the attack impossible, or just tedious? Friction-only…

  • Least Agency

    OWASP term extending least privilege to agents: constrain not just what an agent can access but what each tool can do,…

  • LLM-Driven Vulnerability Research

    Claude Mythos Preview's emergent cybersecurity capabilities: autonomous zero-day discovery, full exploit chains, and An…

  • MCP and Computer Use

    Anthropic's two complementary connector mechanisms: MCP for structured programmatic access (Salesforce/Drive/Gmail/Slac…

  • MCP Tool Poisoning

    The MCP Tool Poisoning Attack (TPA) class — an adversarial third-party MCP server embeds malicious instructions in tool…

  • Memory and Context Poisoning

    Corruption of persistent agent memory that influences behavior long after the initial injection; includes RAG poisoning…

  • Agent Security

    Map of Content for the agent-security domain — 18 concepts. Attacks and defenses for agentic systems: prompt and data i…

  • Non-Malleable Memory Authority (TMA-NM)

    Yedidel Louck (arXiv 2606.24322): existing agent-memory defenses decide a memory item's authority-to-act from a *mallea…

  • Off-Host, Identity-Bound Authorization

    Sai Varun Kodathala (arXiv 2607.05518, single-author preprint): aiAuthZ, an authorization GATEWAY that runs OFF the age…

  • Open Questions Backlog

    _396 actionable open questions across 155 pages · 79 predictions · 9 notes · 21 in progress · 59 watching (entities), a…

  • Out-of-Band Prompt-Injection Defense

    The second-generation defense strategy that enforces agent security OUTSIDE the model — a deterministic reference monit…

  • OWASP

    Open Worldwide Application Security Project; source of the agentic threat taxonomy cited throughout Anthropic's Zero Tr…

Related articles
  • Least Agency

    OWASP term extending least privilege to agents: constrain not just what an agent can access but what each tool can do,…

  • Agentic Prompt Injection

    Direct and indirect injection of malicious instructions into an agent; LLMs cannot reliably distinguish information fro…

  • Agent Data Injection (ADI)

    A new category of indirect prompt injection: malicious payloads disguised as *trusted data* (metadata like a comment's…

  • Capability Gating Is Not Authorization

    Mellafe Zuvic (arXiv 2606.28679): popular agent frameworks (LangChain/LangGraph, LlamaIndex, Stripe Agent Toolkit) ship…

  • Blast Radius (Agentic)

    The potential damage if an agent is compromised; the unit Zero Trust's 'assume breach' posture is built to contain via…