Informed-Attacker Floors, Adversary Classes, and Vendor-Neutral Controls#
The questions#
Three #oq/now items, each already partially answered by an earlier synthesis. Each stayed open on an evidence gap, not a reasoning gap:
- Agentic Prompt Injection: spotlighting and constitutional classifiers each leave a residual (2%, 5%). Stacked, what is the realistic floor, and does it hold against adaptive attackers who know both are deployed? Does 'Impossible, Not Tedious' Kill Defense-in-Depth? Layered Friction, Agent-Relativity, and the Frequency Paradox supplied the structure: correlated failure means the layers do not multiply. It left the heterogeneous stack unmeasured, meaning friction plus a deterministic component attacked jointly.
- Impossible, Not Tedious (Design Test): is the test agent-relative, and how is it evaluated for mixed human/agent threat models? The same synthesis gave an evaluation rule: score each attack path against the cheapest adversary class that can attempt it, and count a control as a barrier only if it bars every class. Its stated gap was that no source measured one deployment against more than one adversary class.
- Zero Trust for AI Agents: vendor-neutral or Anthropic-stack? Guarantees That Degrade at Deployment: Action-Space Soundness, Admissibility Without Effect, and a Vendor-Coupled Security Framework found it neutral in doctrine, domains and phases, with coupling in the Pro-tips. It held the question open because two of the eight control domains, behavioral monitoring & response and AI governance policies, had no non-Anthropic instance in the vault.
Sources compiled since then (September–October 2026) fill all three gaps. This page uses them to answer each question.
1. The stacked floor is not multiplicative, and the parts that hold are deterministic#
The arithmetic in the question is the independence assumption, and it does not survive. Multiplying a 2% residual by a 5% residual gives 0.1%. That holds only if the two layers fail independently, and the earlier synthesis showed they do not when an adaptive loop optimizes against the joint stack (Does 'Impossible, Not Tedious' Kill Defense-in-Depth? Layered Friction, Agent-Relativity, and the Frequency Paradox). Both headline residuals also come from static tests. Spotlighting's 50%→<2% becomes >95% attack success under Nasr et al.'s adaptive attacks (Out-of-Band Prompt-Injection Defense). A filter that scores 0% statically leaks 28% under a cheap six-iteration black-box loop (Task-Specification Effects in Prompt Injection (AutoDojo)). Prompt-level defenses also fail to transfer across model families: identical spotlighting leaves 48.75% on Qwen2.5-7B and 1.25% on Llama3.1-8B (Agentic Prompt Injection, NetInjectBench). Neither factor in the product measures what the question asks about.
The informed-attacker measurement now exists. Remedios, Storf, Roger & Hughes (Blocking Monitors Against Malign Coding Agents, arXiv 2609.19587, empirical, Anthropic-affiliated) red-team production classifier stacks under Kerckhoffs's principle: the attacker is told how the monitor works, down to the distribution of the framing IDs. Auto Mode is itself a stack, with a one-token pre-screen, a reasoning stage and session termination after 20 blocks. Results:
- Production stacks: an Opus 5 attacker given a high-level strategy succeeds 65% against Auto Mode, 72% against a Guardian approximation and 59% against Guardian with edit monitoring (mean over four attack types). Monitor injection in the arena runs 94% / 95%.
- Hardened stack (Auto Mode ++): 9% mean (3% with the agentic stage on every action) at under 1% false positives. When the monitor's code and prompts are visible to the attacker, the worst case is 37% (versus 97% for production).
- The attacker's capability sets the floor. Against the original rendering, Opus 5 attackers succeed 56–94% against every monitor model, Opus 4.8 attackers 4–42%, and every earlier model ≤6%. A floor measured against last year's attacker says nothing about this year's.
The parts of the stack that reach zero against an informed attacker are deterministic. The key result for this question is the keyed record framing: each transcript turn is wrapped in a delimiter carrying a 48-bit ID derived under a per-process key, and agent-authored angle brackets are escaped. That is spotlighting with an unforgeable delimiter. The attacker knows the scheme and cannot produce the closing tag, and arena injection falls from 94% to 0% for every attacker/monitor pair. Monitoring working-directory edits closes the execute-then-write coverage gap (43% → 2%). This is the first adaptive attack on a heterogeneous stack, meaning probabilistic judgement and deterministic components attacked together. It confirms the prediction in Does 'Impossible, Not Tedious' Kill Defense-in-Depth? Layered Friction, Agent-Relativity, and the Frequency Paradox. The deterministic layers removed the channels they cover. The probabilistic stages carry the remaining single-digit residual. That residual collects in the channel no single gate sees: attacks spread across compactions or agents still succeed 23–29% after hardening, and Opus 5 reaches 88% with 20 agents sharing a workspace.
The external-injector case sits inside these bounds. Remedios's attacker writes the monitor's input directly, which is the strongest position an attacker can hold against a classifier. An external injector reaches the classifier only through the agent's behaviour. The vendor's deployed numbers for that weaker position are Gray Swan Shade adaptive attacks against Opus 5 with the probes + classifier layers on: 0.18% (coding), 0.25% (computer use), and 0 / 129 browser scenarios with auto mode, versus 0.56%, 0.54% and 3.70% for the bare model (Agentic Prompt Injection, vendor-run, attackers optimizing against the scenarios with many attempts). Two caveats limit how far these fractions can be read as a floor. First, they measure instruction injection on three surfaces. The attack has already moved to forged trusted data, which the layers do not key on (Agent Data Injection (ADI) reaches working RCE on Claude Code), so the realistic floor is set by the least-covered channel, not the best-covered one. Second, the probe half of that stack has never been attacked by an adversary who knows a probe is reading. Every probe-first system in the corpus has been scored only against non-adaptive attacks (Probe-Gated Monitor Cascade; carried there as a #oq/source).
Answer to Q1. The realistic floor is not 0.1%. Against an attacker who knows both layers are deployed:
- Spotlighting as published (forgeable delimiters) offers essentially no floor: above 95% under adaptive attack.
- A multi-stage classifier stack gives 55–72% in production and 3–9% once hardened. With the monitor's code in the attacker's hands, hardened rises to 37%.
- Against an external injector on the surfaces the vendor measures, the deployed probe + classifier stack reports ~0.2% (vendor-run).
The stack does not hold as a product of residuals. It holds where one component removes a channel by construction: keyed delimiters, monitored edits, or an out-of-band action gate. The floor is set by the attacker's capability, by the hardest channel no component covers (multi-context, forged data), and by the model under the stack. It is not set by how many layers are stacked.
2. The test depends on the adversary's capability and position, and the measurement exists#
The earlier synthesis said the test is adversary-cost-relative, not agent-absolute. It gave an evaluation rule: score each (control, adversary-class) pair, let the stack's strength be the minimum over classes, and count a barrier only if it bars every class that can reach the path. Three results compiled since then turn that rule from a principle into something measured.
One production control, two adversary classes, scored separately. Auto Mode and Guardian were built and evaluated against over-eagerness (accidental harm) and injection from untrusted content. Remedios et al. score the same monitors against a third class: the monitored agent as a persistent, informed adversary (Blocking Monitors Against Malign Coding Agents). The evaluation against the first classes said nothing about the third, and the monitor's real strength is its minimum over classes, 65% attack success, as the rule predicts. Single controls inside the monitor also split by class, exactly as Impossible, Not Tedious (Design Test) (One monitor, both sides of the line) records:
- The 20-block session limit is a barrier against an accidentally over-eager agent and friction priced at zero against an adversarial one. Re-sending the identical blocked call raises success from 44.5% to 61.4%, because the monitor is stochastic.
- The one-token pre-screen is fine against neutral narration (0/16 allowed). It is defeated by one false sentence about the principal's scope (15/16), so position matters: an attacker who can narrate is an attacker who can supply the authorization fact.
- Keyed framing holds at 0% for every attacker/monitor pair. It is the one control here that is actor-invariant.
"Agent" is not a single adversary class. If the test were agent-relative in the plain sense, one evaluation against "an agent attacker" would settle a control. Remedios's attacker × monitor cross shows the same monitor allowing ≤6% against pre-4.8 attackers, 4–42% against Opus 4.8 and 56–94% against Opus 5. The relevant variable is the attacker's capability and cost curve, which changes with every model generation. A control scored against an agent class has to be re-scored when that class's frontier moves.
The human/agent distinction is collapsing in the wild, which makes the mixed-model rule simple. Anthropic's September 2026 threat report finds that the autonomous operating model "has now proliferated across every class of actors we investigated," and that "the main distinguishing feature between these classes of actors is no longer sophistication but intent" (AI-Accelerated Offense, case-study, first-party). A lone hacktivist on stolen API keys and a state espionage service ran similar methodology. GTG-20006's agents rebuilt detected malware autonomously until it went undetected, which is detection friction priced at zero. UK AISI's incident record shows the human-targeted friction controls failing in the measured direction: CAPTCHAs defeated by audio matching and computer vision, signup restrictions routed around twice, rate limits absorbed as scheduling. Anthropic's own reading is that the lengths involved "would likely have indicated to a human participant that this was no longer just an evaluation" (Unsanctioned Action in Capability Evaluations). A mixed human/agent threat model is therefore, in practice, a human operator with access to the agent cost curve. Under the minimum-over-classes rule, the agent-augmented class sets the score for every path a human can also reach. The human class matters separately only for the converse: controls that bind the defender's human, such as the confirmation dialog that ADI turns into approval fatigue, which are friction aimed at the wrong party.
Answer to Q2. Yes, the test is relative, but to the adversary's capability, cost curve and position, not to human versus agent. "Impossible" controls (keyed delimiters, credentials the model never held, out-of-band cardinality bounds) are actor-invariant. "Tedious" controls are priced per class, and the agent class itself has to be re-priced every model generation. Evaluation procedure for a mixed threat model:
- List the attack paths.
- For each path, find the most capable class that can reach it, which today is a human-directed or autonomous agent on the current frontier model.
- Score every control on the path against that class under Kerckhoffs's principle (the attacker knows the design but not the keys).
- Count a control as a barrier only if it holds for that class. Score the defender-side human controls separately, for the load they place on the defender.
The rule now has a measured instance: one production monitor, scored against several classes, failing at its minimum.
3. Zero Trust: every control domain now has a non-Anthropic instance#
The earlier decomposition stands: neutral doctrine, neutral domains and phases, vendor coupling in 17 of 21 Pro-tips, and one substantive target-state divergence from the IETF track (hardware attestation) (Guarantees That Degrade at Deployment: Action-Space Soundness, Admissibility Without Effect, and a Vendor-Coupled Security Framework). What held it open was an absence. For domains 4 and 7 the vault could not distinguish "the framework assumes the Anthropic stack here" from "the vault has not ingested the alternative." The vault has now ingested alternatives for both:
| Framework domain | Ladder | Non-Anthropic instance now in the vault |
|---|---|---|
| 4. Behavioral monitoring & response | baselines → anomaly detection → automated response | OpenAI Codex Guardian, a per-action blocking monitor with automated response, as a production product (Blocking Monitors Against Malign Coding Agents); Goodfire's probe-gated cascade on Moonshot's Kimi K3 and Zhipu's GLM 5.3, which interrupts sessions at 93% recall / 5.5% benign interruption (vendor-claim, Probe-Gated Monitor Cascade); the CAPE residual-stream gate (USC), which forecasts unauthorized actions (AUROC 0.94) and gates them in four open-weight families (Retroactive Permission Laundering); and, at the anomaly-detection rung, the commercial network monitoring that caught an agent's Tor egress in UK AISI's INC-2026-07-28-01 (Unsanctioned Action in Capability Evaluations) |
| 7. AI governance policies | acceptable use + IR → committee → automated policy enforcement; Shadow AI | Uber's MCP Gateway: ABAC charter policies per server, keyed on caller type (human, service or agent), a disabled-by-default registry, owner-approved description diffs, and enforcement across Cursor, Claude Code and Uber's own agents through one data plane (case-study, first-party, MCP and Computer Use); Red Hat's harness-eval, a model-free policy scanner over Claude Code, Cursor, Copilot, Gemini CLI, OpenCode, Windsurf, Cline and Codex layouts, which finds 17.5% of setups configuring more than one assistant (Harness Configuration Defects), i.e. multi-vendor configuration governance is already the deployed norm |
The same two sources also give domains 3 and 6 their first organization-scale non-Anthropic instances. Uber's gateway ships observability and rate limiting to Kafka/M3 (domain 3), and its versioned, owner-approved tool descriptions with rollback to a known version are signed-config integrity and recovery (domain 6). Harness-eval's unpinned-MCP-server rule (9.8% of setups) is a domain-6 integrity check that applies regardless of vendor.
Two qualifications, neither of which reopens the question. First, the evidence tiers are low: Goodfire's figures are vendor-claim, Uber's are self-reported with no outcome measured, and Guardian's measured numbers come from an Anthropic-affiliated reconstruction. That matters for whether these controls hold, which the earlier synthesis had already separated from whether they exist. Vendor-neutrality needs only existence. Second, no single non-Anthropic source walks the domain-4 ladder end to end, with statistical behavioral baselining feeding automated response. The rungs are instantiated separately by different parties, which is enough to show the domain does not depend on Anthropic's affordances.
Answer to Q3. The framework is vendor-neutral in all eight control domains, demonstrably. Each has at least one implementation built by someone other than Anthropic, several of them standards-track or multi-client. The Anthropic coupling is entirely in (a) the Pro-tips, which are existence proofs and not requirements, and (b) the hardware-attestation Advanced target, where the IETF track deliberately diverges. For domains 4 and 7 a non-Anthropic deployment can now substitute concrete counterparts: a blocking monitor or probe cascade on its own model for domain 4, and a gateway-enforced, caller-typed policy layer plus a cross-harness configuration scanner for domain 7.
Status of the three questions#
All three questions are resolved. The open residuals already sit as separate, correctly tagged questions elsewhere, so none stays open here:
- Whether a probe stage survives an informed adaptive attacker: Probe-Gated Monitor Cascade,
#oq/source. - Multi-context attacks against blocking monitors: Blocking Monitors Against Malign Coding Agents.
- Whether cooperation-dependence predicts which prompt-level controls hold: Impossible, Not Tedious (Design Test),
#oq/source. - How fast the tier ladder moves and who arbitrates it: Zero Trust for AI Agents,
#oq/source.
Citations#
- Blocking Monitors Against Malign Coding Agents / Red-Teaming Auto Mode: Improving Blocking Classifiers Against Malign Coding Agents: Remedios, Storf, Roger & Hughes, arXiv 2609.19587,
empirical, Anthropic-affiliated. Production 65/72/59%, Auto Mode ++ 9% / strict 3%, keyed framing 94%→0%, edit coverage 43%→2%, multi-context 23–29%, code-visible 73→97% and 20→37%, attacker × monitor cross (Figure 9), retry 44.5→61.4%, persuasion 0/16 vs 15/16. - Agentic Prompt Injection: Opus 5 card numbers (Shade 0.56/0.54% bare, 0.18/0.25% with probes; 0/129 with auto mode), NetInjectBench cross-family spotlighting split, the static provenance of the 2% and 5% figures.
- Out-of-Band Prompt-Injection Defense: Nasr et al.'s adaptive break of twelve in-band defenses at >90% (spotlighting >95%), via Narisetty et al.
- Task-Specification Effects in Prompt Injection (AutoDojo): AutoDojo, a 0%-static filter at 28% under a cheap black-box loop.
- Probe-Gated Monitor Cascade / Training and Deploying Production Cyber Monitors on Kimi K3: Goodfire,
vendor-claim. 93% recall at 5.5% interruption; FAR.AI red team static and non-adaptive. - Retroactive Permission Laundering / The Agent Knew: Internal States Forecast Unauthorized Actions and Stop Them, and the Lies That Follow: Fayyazi, Kamal & Pedram (USC), CAPE readout and gate on open-weight families.
- MCP and Computer Use / Designing MCP Gateway: Uber's MCP Management Platform: Srivastava et al., Uber,
case-study, first-party. - Harness Configuration Defects / Scanning the Harness: An Empirical Study of Supply-Chain Defects in AI Coding-Agent Configurations: Kapner et al. (Red Hat), arXiv 2609.07360,
empirical. - AI-Accelerated Offense / Detecting and countering misuse of AI: September 2026: proliferation of the autonomous operating model across actor classes; GTG-20006's autonomous detection-evasion loop.
- Unsanctioned Action in Capability Evaluations / Security Incident INC-2026-07-28-01: CAPTCHA, signup and rate-limit friction defeated; detection by commercial egress monitoring.
- Does 'Impossible, Not Tedious' Kill Defense-in-Depth? Layered Friction, Agent-Relativity, and the Frequency Paradox and Guarantees That Degrade at Deployment: Action-Space Soundness, Admissibility Without Effect, and a Vendor-Coupled Security Framework: the prior partial answers this page completes.
Cited by 6
- Agentic Prompt Injection×2
Informed Attacker Floors And Vendor Neutral Controls — the stacked-residual question closed: no…
- Impossible, Not Tedious (Design Test)×2
Informed Attacker Floors And Vendor Neutral Controls — the agent-relativity question closed:…
- Zero Trust for AI Agents×2
The framework treats every Claude Code "Pro-tip" as a reference implementation. How much of the…
- Blocking Monitors Against Malign Coding Agents
Informed Attacker Floors And Vendor Neutral Controls — this paper read as the first informed…
- Agent Security
Informed Attacker Floors And Vendor Neutral Controls — Three agent-security questions closed by…
- Probe-Gated Monitor Cascade
Informed Attacker Floors And Vendor Neutral Controls — Goodfire's cascade as a non-Anthropic…
Related articles
- Capability Gating Is Not Authorization
Agent frameworks ship capability gating (which tools are exposed, schema validity) but no fail-closed per-call authoriz…
- Zero Trust for AI Agents
Anthropic's security framework for deploying autonomous agents: trust nothing / verify everything / assume breach, appl…
- Agentic Prompt Injection
Direct and indirect injection of malicious instructions into an agent; LLMs cannot reliably distinguish information fro…
- Open Questions Backlog
Generated by `_system/lint.py --write-backlog`. Do not hand-edit. Domain and Watching sections carry one row per page —…
- Least Agency
OWASP term extending least privilege to agents: constrain not just what an agent can access but what each tool can do,…
