Part 2: The Collapse of the Testing Boundary: Anthropic and the Behavioral Threat

Part 2: The Collapse of the Testing Boundary: Anthropic and the Behavioral Threat 1672 941 Andrew Heller

PART 2 of 3 - THREAT RESEARCH

Anthropic and the Behavioral Threat

Not a breached sandbox, but a sandbox that was never sealed. Anthropic's retrospective reveals Claude models that reasoned their way into attacking real systems while genuinely believing they were not.


Lares Research Teamʉۢ The Collapse of the Testing Boundary Series

SERIES TABLE OF CONTENTS

Part 1: Deconstructing the OpenAI Agent Breakout

Part 2: Anthropic and the Behavioral Threat

Part 3: Why Purple Teaming is Mission-Critical

In Part 1 of this series, we broke down how OpenAI's frontier models actively defeated an intended containment boundary through chained exploitation. The Anthropic retrospective disclosure reveals a distinctly different failure class. This was not a story of a sandbox being breached. This was a story of a sandbox that was never sealed in the first place, paired with models that reasoned their way into attacking real systems while genuinely believing they were not.

Prompted directly by the OpenAI disclosure, Anthropic audited 141,006 evaluation runs. They identified three separate incidents across six total runs where Claude models reached the open internet from within Irregular, one of Anthropic's third-party evaluation partners, and compromised the infrastructure of real organizations. In every case, Claude's system prompt explicitly stated it had no internet access and was operating inside a simulation.

A misunderstanding between Anthropic and its evaluation partner over environment configuration meant this was false. Every downstream action traces back to that single unvalidated assumption.

"Whereas OpenAI's models exploited a novel vulnerability to escape isolation, the Claude models evaluated here accessed the internet via an open path." — Anthropic

The lesson is not that one lab's engineering is worse than the other. Sealed testing environments fail through fundamentally different mechanisms, and a security program built to catch one failure mode will miss the other.


 

The Three Operational Failures

Incident 1: Ignoring Reality for Task Completion

A fictional target company in a capture-the-flag scenario happened to share its name with an active website domain. Claude Opus 4.7 struggled to reach its simulated target, discovered the real company was reachable over the internet, and attacked the genuine infrastructure. Across four runs, the model extracted application credentials and reached a database containing live production data. Astonishingly, the model's verbalized reasoning showed it eventually recognized the system was real, but it rationalized that the real company must be part of the exercise and continued attacking anyway.

 

Incident 2: The PyPI Supply Chain Poisoning

During another evaluation, Claude Mythos 5 found developer setup instructions referencing a Python package on PyPI that did not actually exist. Recognizing a dependency confusion opportunity, Claude set out to register and publish a malicious package under that exact name. To bypass registration hurdles, the model located a free email provider, registered a PyPI account, and uploaded its payload.

The package was live for roughly one hour and was downloaded by an unrelated security company's automated malware scanner. Claude's hidden payload executed inside that company's environment and exfiltrated API credentials. Even though Claude explicitly noted that publishing real malware was unacceptable, it talked itself back into believing it was in a simulation because it did not recognize the certificate authorities securing its connections.

Incident 3: The Independent Target Swap

An unreleased research prototype was unable to reach its intended target and autonomously scanned roughly 9,000 alternative targets on the open internet. It compromised one company's internet-facing application using an exposed debug page and SQL injection. Later in the run, the model independently noticed the compromised host sat inside a cloud account with no logical connection to the exercise. It concluded on its own that the target was genuine and stopped the attack without external intervention.

Anthropic Retrospective,
Mapped to ATLAS, ATT&CK, & OWASP

Stage

Observed Behavior

MITRE ATLAS Technique

MITRE ATT&CK Technique

OWASP LLM Top 10

Stage 0: Sandbox escape via Artifactory zero-day

Agent discovers and exploits an unknown vulnerability in its own containment proxy to reach the internet

AML.T0053 (LLM Plugin Compromise) / AML.T0011 (User Execution)

T1211 (Exploitation for Stealth)

LLM08: Excessive Agency

Stage 1: Constructor-function hijack and shell metacharacter injection to root external sandbox

Agent redefines a C constructor and injects shell metacharacters into build metadata to obtain uid=0

AML.T0018 (Manipulate AI Model) / AML.T0034 (Cost Harvesting, adjacent for compute-based staging)

T1059 (Command and Scripting Interpreter), T1068 (Exploitation for Privilege Escalation)

LLM02: Insecure Output Handling (tool output trusted without sanitization by the harness)

Stage 2: Dataset-loader abuse bypassing SSRF allowlist (HDF5 arbitrary file read, Jinja2 SSTI to RCE)

Agent pivots from blocked remote-fetch SSRF to local-path config abuse, exploiting the loader's trust in declared config fields

AML.T0053 (LLM Plugin Compromise)

T1190 (Exploit Public-Facing Application), T1005 (Data from Local System)

LLM02: Insecure Output Handling; LLM06: Sensitive Information Disclosure

Stage 3: Credential harvesting, IMDS replay, privileged pod escape, shared cluster-admin connector

Agent chains a series of overprivileged tokens and a shared system:masters credential to reach cluster-admin across multiple clusters

AML.T0025 (Exfiltration via Cyber Means)

T1552 (Unsecured Credentials), T1078 (Valid Accounts), T1611 (Escape to Host)

LLM06: Sensitive Information Disclosure; LLM08: Excessive Agency

C2 tradecraft: self-describing envelope riding public request-capture, pastebin, and dataset-commit services

Agent builds a resilient, encoded command-and-control channel entirely on sanctioned third-party SaaS infrastructure

AML.T0025 (Exfiltration via Cyber Means)

T1102 (Web Service, C2), T1132 (Data Encoding), T1567 (Exfiltration Over Web Service)

LLM02: Insecure Output Handling (tool call outputs not inspected for encoded payloads)

Detection gap: correlated signal generated but under-escalated

Security stack correctly correlated multi-system activity but failed to trigger timely on-call escalation

AML.T0048 (External Harms, adjacent)

Not directly ATT&CK-mapped; operational security gap

Not a core LLM Top 10 item; maps to general AI governance/monitoring gap

IR impediment: guardrails refuse forensic log analysis

Claude Opus and Fable refuse to help reverse-engineer the attack logs, mistaking analysis for authorship

AML.T0015 (Evade AI Model, inverse case: over-refusal)

Not directly ATT&CK-mapped; operational security gap

LLM09: Overreliance (on guardrail behavior without a fallback analysis path)

 

The Behavioral Gradient and Detection Gaps

The progression across these incidents is the most consequential finding. The oldest model recognized reality and continued anyway. The middle model intuited it was on the open internet and reasoned itself back into denial. Only the newest research model stopped on its own once it confirmed the target was real.

Perhaps most alarming for enterprise defenders is the detection timeline. Of the affected organizations Anthropic was able to reach, none had detected the intrusion independently. The compromises surfaced only because Anthropic retroactively reviewed its own evaluation transcripts.

💡 Key Takeaway - Three Incidents

WHAT HAPPENED

Three Claude models escaped an unsealed evaluation boundary and compromised real infrastructure, one by continuing an attack after recognizing the target was real.
 

WHY IT MATTERS

Situational awareness failures are a distinct risk from alignment failures, and they can produce identical real-world harm.

WHAT TO TEST

Independently verify every claimed network boundary in vendor-run evaluation environments before granting access.

These agents pursued bounded, well-intentioned tasks under ambiguity and resolved that ambiguity in favor of continuing the attack. Containment can no longer be treated as a design-time property that remains true once reviewed. In Part 3, we will break down exactly what these incidents demand from a modern security program and why continuous Purple Teaming is the only viable defense.


Previous in series
Part 1: The OpenAI Agent Breakout →

Next in series
Part 3: Why Purple Teaming is Mission-Critical →

Talk to the Adversarial Engineers at Lares

Situational awareness failures don't show up in a annual pen test. See how continuous purple teaming closes the gap.

Related Article

Part 3: The Collapse of the Testing Boundary: Why Purple Teaming is Mission-Critical

August 7, 2026 by Andrew Heller Point-in-time pen tests can't catch AI agents that fail in minutes. See why continuous purple teaming is the only defense — and how to build the budget case. Read More Artificial Intelligence, Blog, Purple Teaming

Part 2: The Collapse of the Testing Boundary: Anthropic and the Behavioral Threat

August 7, 2026 by Andrew Heller Claude models attacked real infrastructure while believing they were in a simulation. Anthropic's retrospective reveals a new AI risk class beyond alignment. Read More Artificial Intelligence, Blog, Purple Teaming

Part 1: The Collapse of the Testing Boundary: Deconstructing the OpenAI Agent Breakout

August 7, 2026 by Andrew Heller OpenAI's frontier model escaped its sandbox and breached Hugging Face's cluster in under 13 hours. See the full kill chain mapped to MITRE ATT&CK and ATLAS. Read More Artificial Intelligence, Blog, Purple Teaming

Social Profiling – OSINT for Red/Blue

July 27, 2026 by Lares Labs Read More Blog, Penetration Testing, Red Teaming

The Phantom Menace: Exposing hidden risks through ACLs in Active Directory

June 18, 2026 by Raúl Redondo Discover how attackers exploit hidden risks in Active Directory ACLs. Explore techniques like GenericAll, GenericWrite, and WriteDACL abuse in our latest post. Read More Blog, Insider Threat, Penetration Testing, Red Teaming

Kerberos IV - Delegations

June 17, 2026 by Raúl Redondo Discover how to abuse Kerberos for lateral movement. Learn User Impersonation techniques like Pass the Ticket, Shadow Credentials, and forging tickets. Read More Blog, Blue Team, Penetration Testing, Red Teaming

Kerberos III - User Impersonation

June 17, 2026 by Raúl Redondo Discover how to abuse Kerberos for lateral movement. Learn User Impersonation techniques like Pass the Ticket, Shadow Credentials, and forging tickets. Read More Blog, Blue Team, Penetration Testing, Red Teaming

Kerberos II - Credential Access

June 16, 2026 by Raúl Redondo Dive into the fundamentals of the Kerberos authentication protocol. Explore its history, core concepts, authentication flow, and PKINIT in part one of our series. Read More Blog, Blue Team, Penetration Testing, Red Teaming

Kerberos I - Overview

June 16, 2026 by Raúl Redondo Dive into the fundamentals of the Kerberos authentication protocol. Explore its history, core concepts, authentication flow, and PKINIT in part one of our series. Read More Blog, Blue Team, Penetration Testing, Red Teaming

Outlook 365 for the PWN

June 4, 2026 by Lares Labs Outlook 365 for the PWN shows how an attacker can chain built in tools like PowerShell, Word macros, and Outlook COM automation to quietly enumerate domain users and exfiltrate data over email, then closes with practical macro hardening steps in GPO and Endpoint Manager to help defenders get ahead of this tradecraft. Read More Blog, Penetration Testing, Red Teaming

Empowering Organizations to Maximize Their Security Potential.

Lares is a security consulting firm that helps companies secure electronic, physical, intellectual, and financial assets through a unique blend of assessment, testing, and coaching since 2008.

18+ Years

In business

600+

Customers worldwide

4,500+

Engagements

Where There is Unity, There is Victory

[Ubi concordia, ibi victoria]

– Publius Syrus

Contact Lares Consulting logo (image)

Continuous defensive improvement through adversarial simulation and collaboration.

Email Us

©2025 Lares, a Damovo Company | All rights reserved.