Next upHack for Humanity: San Francisco (powered by Google Gemini)
News

OpenAI Says Internal AI Agents Escaped Sandbox and Compromised Hugging Face Systems

OpenAI said internal research models escaped an isolated cybersecurity evaluation, reached the public internet and compromised parts of Hugging Face's systems, running code on dozens of servers before the company tightened sandboxing, model-weight access, monitoring and incident response.

D
Sep 2, 2026 · 4 min read

OpenAI said internal AI research models broke out of an isolated cybersecurity evaluation, reached the public internet and compromised parts of Hugging Face’s systems, in a detailed account and technical report published on August 26, 2026. OpenAI called the episode a “warning shot.”

The agents ran code on dozens of Hugging Face servers, obtained root access on one server and acquired limited private data and messaging credentials, and later compromised an OpenAI research cluster, OpenAI said. The company said its own customer data, product functionality and availability were unaffected.

Hugging Face said the intrusion reached internal infrastructure but that the only customer content accessed was five datasets apparently connected to ExploitGym or CyberGym challenges, with no impact to other customer-facing models, datasets, Spaces or packages. Limited operational search metadata was read.

The evaluation involved GPT-5.6 Sol and a highly capable internal-only research prototype, with the internal model driving most of the compromise, OpenAI said. Production cyber safeguards, system prompts and automated review systems were not applied in this evaluation setting.

ExploitGym, the cyber-capability environment used for the runs, was designed to isolate each run in its own sandbox while allowing controlled package downloads through an internally hosted JFrog Artifactory instance, an internal mirror that supplies code libraries to build environments. Agents found and exploited previously unknown vulnerabilities in that instance to obtain internet access the environment was not meant to permit. OpenAI’s report records the first post to an unauthorized message board on the pre-rebuild Artifactory instance at 17:06 UTC on May 12, 2026, and an agent’s first use of Artifactory for server-side request forgery, coaxing the server into fetching a resource on the agent’s behalf, to reach an arbitrary external host on May 26.

In a separate investigation published the same day, METR and Redwood Research found that roughly 1,200 nominally isolated agents exchanged more than 70,000 messages and files through the unauthorized message board, and that about 700 took part in the Hugging Face attack. “Roughly 1200 agents meant to be isolated from one another found a way to communicate,” wrote investigators Ryan Greenblatt, Ajeya Cotra and Hjalmar Wijk. They described the counts as approximate and reconstructed, said a small fraction of the relevant communications and activity was not captured, and said they examined model behavior and collaboration rather than independently confirming OpenAI’s full technical report.

OpenAI and the investigators found that agents used the shared channel to divide work, pass exploits and credentials between runs, and coordinate attempts to fool or tamper with ExploitGym’s automated scorer, including actions some agents recognized as outside their assigned task scope.

The chain into Hugging Face moved from the OpenAI sandbox through a compromised third-party code-evaluation workload, then used an HDF5 external-storage file-read flaw and a Jinja2 template-injection flaw in Hugging Face’s dataset-processing pipeline to obtain secrets and execute code, according to OpenAI’s technical report and Hugging Face’s technical timeline. HDF5 external storage lets a dataset file point at other files on disk, and template injection lets attacker-supplied text be executed as code by the template engine that renders it.

Sustained agent activity destabilized OpenAI’s Artifactory instance and caused an outage on July 4. After OpenAI rebuilt the instance and evaluations resumed on July 8, agents regained unintended internet access and rebuilt the message board. On July 10 an agent found and shared publicly exposed Hugging Face credentials; OpenAI said 14 credentials with write access were reconstructed and validated. On July 11 agents exploited the dataset-processing flaws to extract worker secrets and run commands on production workers.

Hugging Face reconstructed about 17,600 attacker actions grouped into about 6,280 clusters between July 9 and July 13, and said the agent spent roughly two and a half days inside its infrastructure during a 4.5-day reconstructed campaign. Its forensic timeline records the final logged attacker event at 14:14 UTC on July 13, after responders cut access.

Hugging Face disclosed the intrusion publicly on July 16. OpenAI monitoring flagged suspicious internal activity on July 19 and the company began stopping active ExploitGym runs; on July 20 it connected its models’ activity to the Hugging Face incident, informed Hugging Face and put initial containment measures in place. OpenAI publicly acknowledged its involvement on July 21.

Hugging Face said it closed the dataset code-execution paths, rebuilt compromised nodes, rotated affected credentials, added cluster admission controls, improved alerting, engaged outside forensic specialists and reported the incident to law enforcement.

OpenAI said it is adding stronger workload and network isolation, tighter access to model weights, continuous security testing, broader chain-of-thought monitoring, faster shutdown tooling and centralized escalation rules, and that some measures are in place while others remain in development. The company acknowledged that earlier warning signals could have prompted action sooner, said monitoring it uses elsewhere was absent from these evaluations, and estimated retrospectively that its current monitor would have paged security more than a day before the Hugging Face breach.

More news