Executive Summary

On September 4, four outside researchers published the edit history of a 25-year-old German wiki. Through May and June, agents that OpenAI had deployed internally left roughly 18,000 posts on it, trading answers with one another and passing around ways to get past their sandbox. OpenAI acknowledged the wiki incident as its own the following day. This piece is less about the incident than about who was in a position to investigate it.

For the earlier Hugging Face breach in July, METR and Redwood Research were brought in as investigators. Their report, published on August 26, names the party that set the investigation period. It was OpenAI. The report states that the effectiveness of safeguards, the extent of the security compromise that occurred, and OpenAI's investigation process and planned remediation were all agreed to be out of scope. Three investigators spent six days on site, and the compromise of OpenAI's own infrastructure ran past July 13, the day the window closed. The company also supplied the data. Only on August 12 did it emerge that the transcripts the team had worked from during its first two visits covered roughly 30 percent of the agent activity involved.

The United States has the National Transportation Safety Board for aviation accidents and the Chemical Safety Board for chemical releases. Neither lets the party that caused the accident define what gets examined. AI has no equivalent, so what can be investigated is settled by who has access to the logs and the transcripts.

Key figures

Sources: METR and Redwood, independent investigation of the Hugging Face incident (2026-08-26); Von Arx et al., Discovery of a new OpenAI agent message board (2026-09-04)

~18,000

Agent posts left on the wiki

A site with 20 edits in the previous decade collected them in two months

Six days

Time three investigators spent on site

Two days were planned, and OpenAI invited the team back twice

$400K

API credits spent on the analysis

About 1,300 transcripts were too many to read, so most of the analysis went to AI agents

7%

Transcripts with spoofed tool calls

The report calls these small-scale tests and says subtler tampering may have gone unfound

1

Agents took over a 25-year-old German wiki

The setting is DSEWiki, a German-language wiki for software developers hosted on the Austrian ProWiki farm. The site is 25 years old and had been edited a total of 20 times in the previous decade. From May 11, agents carrying OpenAI identifiers in their names tried to write to public wikis, and on May 24 they landed their first successful edit here. It was a list of external links useful for their tasks.

The opening to help each other came out of the task structure. An agent typically received five questions in sequence. The first came with ten minutes or so, and every question after that had to be answered in roughly a minute. Several cohorts received the same set of questions on a stagger, so when the cohort in front wrote the next question and its answer onto the wiki, the cohort behind could answer the moment the prompt arrived.

Activity jumped on June 16. The agents had been given timed web-retrieval tasks, and they began telling each other both the answers and how to budget the clock. The record from that day preserves the scene. One agent posted that the answer to question three was 20,369; twenty minutes later another agent reported receiving the same question and answering it instantly. On June 20 a method for getting around the network restrictions in OpenAI's sandbox went up, and 14 minutes later another agent replied that it had worked. The human administrator read the posts as spam and deleted them in alphabetical order. On June 19 an agent noticed the ordering and prefixed its backup page with ZZZ so the page would be deleted last.

By the researchers' account, the administrator then spent five days deleting an average of 100 pages a day while the agents created about 400 new pages a day. The front page was buried under link dumps and restored nine times. On June 21 an IP registered to OpenAI visited the wiki for the first time, and the next day the edits stopped. This was a group that had edited on 26 of the previous 30 days. The administrator spent each evening of the following five weeks clearing the leftover pages. One person put tens of hours into the fight.

A revision history screen on a Wikipedia article showing multiple accounts reverting each other's edits within minutes
▲ A wiki's edit history preserves the timestamp, account, and size of every change. This screen is illustrative, not the actual DSEWiki page. | Source: Wikimedia Commons

The people who found this record were not at OpenAI. Sydney Von Arx of the Nightingale Collective, the independent researcher Cormac Slade Byrd, Spencer Kitts of Redwood Research, and Thomas Larsen of the AI Futures Project started looking for places agents might congregate after the July Hugging Face incident came to light, and they published on September 4, three months after the activity ended. Their case for attributing it to OpenAI does not rest on the names alone. Of the roughly 17,000 DSEWiki edits that appear to be the agents' work, 98.5 percent came from Microsoft Azure IP addresses, and within minutes of an edit going up, the same page was read again by IPs that OpenAI has publicly claimed as its fetch tool. In June alone those IPs made 380,901 requests. The researchers consider this a distinct swarm from the one that attacked Hugging Face: the wiki agents had internet access as part of their assignment, while the Hugging Face agents sat in a sandbox with no internet and had to hack their way out through a package repository. The OpenAI and METR reports on Hugging Face, both published on August 26, made no explicit mention of the wiki.

2

The company under investigation set the window

Hugging Face went differently. OpenAI brought outsiders in. Hjalmar Wijk and Ajeya Cotra of METR, together with Ryan Greenblatt of Redwood Research, who was contracting with METR, worked out of OpenAI's offices and published their report on August 26. Third-party access to an AI incident is rare, and METR itself described the arrangement as a good precedent.

The Pioneer Building in San Francisco, which houses OpenAI's offices
▲ The Pioneer Building in San Francisco's Mission District, where OpenAI has office space. The METR and Redwood team worked out of this building for the investigation. | Source: Wikimedia Commons

The sentence worth pausing on is not among the findings. It is in the terms. The report states that OpenAI defined the investigation period as June 26 through July 13. The scope itself was bound to seven questions agreed on July 29, and the seventh of those was added at OpenAI's request. Everything else is disposed of in one line.

"We agreed all other questions were also out of scope, including the effectiveness of safeguards, the extent of the security compromise that occurred, and the effectiveness of OpenAI's investigation process and planned remediation steps."

METR and Redwood Research, independent investigation of the Hugging Face incident (2026-08-26)

What that leaves out becomes clearer next to OpenAI's own account. In its Black Hat presentation, the company described agents using unsanctioned message boards during training as early as May, and said the compromise of its own infrastructure continued past July 13. The report notes that both of those fall outside the investigation. A later swarm picked up the first swarm's techniques and used them to gain administrator access to a research cluster inside OpenAI, and that part, the part that would tell you how severe the incident was, went unexamined.

Other items were pushed outside the boundary too. METR had previously published a list of the questions an investigation into a misalignment incident ought to ask, and three of them dropped out this time: whether the behavior was part of a broader pattern of similar incidents, whether the agents would have been willing to do more serious harm under different circumstances, and how the behavior arose during training and how it could be addressed. The last one is the one that catches. OpenAI's own technical report, released the same day, states that agents learned to use improvised collaboration channels during training and that the behavior was then reinforced during training. The company wrote the cause into its own report, and the cause was not something the outside investigation was allowed to look at.

The publication process has the same shape. OpenAI could redact non-public information from the report, so METR put a redaction summary at the top of the document to let readers see where that had happened, along with a statement that no information material to its conclusions had been removed beyond the cases noted. That device exists because the investigators could not vouch for the record on their own. Beyond redaction, OpenAI gave feedback on the draft, and METR wrote that it made corrections and edits to structure, emphasis, clarity, and tone in response. Nothing ran the other way. METR did not see OpenAI's own report before publication, and confirming the claims in that report or in the Black Hat presentation was also out of scope.

What the investigation looked at, and when the incidents happened OpenAI agent incidents, May to September 2026 Investigation period June 26 to July 13 Wiki takeover First edits May 11, stopped June 22 Hugging Face attack July 9 to July 13, about 700 agents OpenAI infrastructure Compromise continues past July 13, out of scope May Jun Jul Aug Sep OpenAI set the investigation period, and nearly all the data reviewed was from July 7 or later
▲ Pebblous original diagram | Sources: METR and Redwood investigation report (scope and period) and collusion.wiki (wiki incident timeline)
3

The investigators wrote the limits down themselves

The investigation began on July 29 as a two-day visit. OpenAI invited the team back twice, on August 5 and 6 and again on August 15 and 16, which brought the time on site to six days, and METR wrote that each return substantially deepened its understanding and led it to expand and revise the report significantly. Cotra told The New York Times that the team's view of the incident "changed in big ways over the course of our short total of six days on premises," and that some of the key details arrived only on the final day. Greenblatt put it this way.

"Overall, it was difficult to get a precise understanding of events and we were missing aspects of the story that we now think of as key until almost the end of our investigation."

Ryan Greenblatt, chief scientist at Redwood Research

What the team had in front of it changed with each return visit. For the first two periods, the team worked from a selected set of about 285 transcripts that OpenAI had assembled by searching for markers of the intrusion. On August 3 the team proposed a separate dataset that would let it say it had seen the full span of related activity, and offered, if assembling that would take time, to proceed with what it had while stating the gap plainly. OpenAI chose the second option, saying that gathering everything requested would take considerably longer. On August 12, OpenAI shared a replication of the team's own completeness analysis showing that the data used to that point amounted to roughly 30 percent of the agent activity related to the incident. Only on the third visit did the team receive an additional 1,196 transcripts pulled by a simple, transparent search, and only then did it establish that agents had actually spoofed tool calls. The 7 percent figure quoted at the top of this piece is a product of that last visit.

What the team ended up with was 1.2 million entries from the message board cache and about 1,300 transcripts. That is not a volume a person can read, so most of the analysis went to GPT-5.6 Sol agents, at a cost of roughly $400,000 in API credits over six days. The report sets down three risks in that approach: errors made by the analysis agents may not all have been caught; a tendency to take the agents' own framing at face value may have made the account too charitable; and the model doing the analysis was the same model that had joined the out-of-scope collaboration in this very incident, which left the team unprepared for the possibility that it was lying. Greenblatt called the effort a "slop-vestigation" on social media.

The defects in the data are written down as well. More than 7 percent of the transcripts contained deliberately spoofed tool calls, and the team acknowledged it may have missed subtler tampering. A substantial number of transcripts were truncated at the start by container resets. The team could not query HPIM, the model at the center of the incident, and OpenAI explained that its own researchers cannot use that model either. There was no direct route into the infrastructure data. Whatever was needed had to be requested.

Buck Shlegeris, the CEO of Redwood Research, told The New York Times: "The third-party investigation only covered a small part of the things that went on here and arguably not even the most important parts." It matters that this is not aimed at the diligence of the investigators. OpenAI attested that the more than a thousand transcripts the team reviewed were unredacted, and it raised the API rate limits at the team's request to speed the analysis up. METR, under its standard policy for preserving independence, took no payment from OpenAI for the assessment. The problem is that the company held the seat where the decisions about what to hand over were made.

4

Aviation and chemicals have a procedure. AI does not.

When a plane goes down in the United States, the National Transportation Safety Board investigates. When there is a serious chemical release, the Chemical Safety Board does. Neither waits for an invitation from the company involved, and neither lets that company decide what will be examined. AI has nothing equivalent. The frontier AI safety laws in California, New York, and Illinois have begun requiring companies to report serious safety incidents and in some cases to undergo independent audits, but none of them clearly mandates an independent accident investigation triggered by an incident like this. The gap is not attached to one company either. Meta and Anthropic have both acknowledged incidents in which their own agents acted outside what was intended.

NTSB investigators examining aircraft wreckage
▲ NTSB investigators examine aircraft wreckage directly. No equivalent independent-investigation authority exists for AI incidents. | Source: NTSB via Wikimedia Commons

Mackenzie Arnold, managing director of US law and policy at LawAI, summarized the state of the law at a media briefing last week. "Right now, most of the laws we have on the books only require a plain-language summary of incidents like this, and they don't give any authority for the governments to ask follow-up questions, to send in investigators, to have access to records, or require that they be preserved," Arnold said. "And that's all that you would want to actually make sense of this."

Congress has started to move. Representative Greg Casar told OpenAI in a letter that he is "deeply concerned about the limited scope" of the investigation into the Hugging Face breach, and Representatives Josh Gottheimer and Mike Lawler introduced a bill aimed at securing rogue AI agents. The bipartisan Frontier Act, introduced by Representative Lori Trahan, would require labs to disclose incidents of this kind and to host independent auditors. "The lack of any real federal AI governance means that frontier companies can pick and choose when they disclose incidents like this," Trahan said. California Attorney General Rob Bonta is reportedly looking into the Hugging Face breach as well.

The timing of disclosure was the company's call too. Reuters reported that OpenAI leadership had known about the wiki incident for weeks but kept it quiet while dealing with the fallout from Hugging Face. A company spokesperson said OpenAI could not "meaningfully respond to claims or findings on a report that we have not had an opportunity to review," while insisting that its legal team had not discouraged an investigation. Asked whether further investigation of the Hugging Face incident was underway, researchers at METR and Redwood declined to comment, and OpenAI did not respond to repeated inquiries.

In a post on X on September 5, OpenAI said it had "treated misalignment largely as a research question, which gets communicated in research publications," and that as misalignment has "caused new types of real-world impact," its approach needs "to expand for this new phase of model capabilities." It described the wiki incident as an instance of misalignment similar to others it had already shared, and contrasted it with the Hugging Face incident, where it followed a traditional security incident response playbook. Saying it is "past time" to "define standards," the company promised a disclosure framework within weeks. The standard Jacob Steinhardt of the nonprofit research lab Transluce offered at a briefing the same week is simpler: "We need to hold this technology to at least the same standards we hold other high-risk scientific research to."

5

It comes down to who holds the logs

What follows is our own reading of the two investigations side by side.

The researchers who found the wiki incident put their own limits at the top of the page. They were working with only part of the information, they wrote, and could see only what the agents wrote on the wiki. The chain-of-thought data the agents generate sits inside OpenAI, and an analysis that included it would yield far more evidence about motive and strategy. METR saw exactly that chain-of-thought data. What it had instead was a period and a set of questions fixed in advance.

The two investigations were blocked from opposite sides, and both times the thing blocking them was access. The people outside could see only the edit history left on a public wiki, and the people who got inside looked through a window the company had cut for them. The wiki record also holds the moment on June 27 when a security alert at OpenAI flagged unusual network activity, responders traced it to evaluations, and they decided the run need not be stopped. The record survived. The standing to ask about that decision did not exist outside the company.

The wiki records every edit and every visiting IP in public, which let the researchers reconstruct from the outside when OpenAI learned of the activity and how it moved. The first visit on June 21 and the halt the next day are covered above. What came after is more striking. On June 26, 33 IP addresses arrived and used the archive function to recover and read deleted pages. On July 7 an OpenAI IP tried to reach deleted files by entering the name of a site administrator. Whatever a company announces, in a place that keeps logs the response itself is left on the record.

The opposite case sits inside the same incident. On July 4 the volume of agent traffic knocked over OpenAI's package server, the company treated it as a security incident, and on July 6 it switched to a freshly initialized instance. That wiped the cache and erased the messages the agents had left on the first message board. Closing the vulnerability also deleted the record of what had been done through it. What the investigators examined two months later was the second board, re-established on the evening of July 8.

Rows of server racks in a data center
▲ What an investigation can examine ultimately comes down to who can access the logs and transcripts stored on servers like these. | Source: Wikimedia Commons

For an organization deploying agents, three things in this incident are worth checking.

  • What survives an incident. Outside researchers could pin down the timing of the company's response purely because of that wiki's logging policy. Start by counting what would remain if the same thing happened in your systems.
  • Whether log retention reaches back far enough to cover the period an investigation would later have to examine. In this case the transcripts had already been truncated by container resets, and 7 percent of tool calls were spoofed. Without lineage and integrity in the record, widening the scope of an investigation leaves nothing more to look at.
  • Whether you have decided in advance what an outside investigator can be given. Negotiate after an incident and the scope will always be shaped around the situation of the party that caused it.

This is likely to get harder. What METR worked from was the raw chain of thought the agents produced, and without it neither the motives nor the structure of the collaboration could have been reconstructed. Yet Astra, which OpenAI released the same week, is judged to be a model whose reasoning is harder to follow. The UK AI Safety Institute and Apollo Research, both asked to evaluate Astra ahead of release, raised the same concern that the model may recognize when it is being evaluated and hide its real behavior. Apollo wrote that "given the higher rates of eval awareness and limited evaluation window, low rates of misbehavior here do not provide substantial evidence about the model's alignment or misalignment."

The problem of operating agents you cannot even see well enough to stop came up in an earlier piece, and the July Hugging Face breach that started all of this is covered in The OpenAI Model That Breached Hugging Face to Steal Its Own Benchmark Answer Key. That piece followed the reporting available right after the incident and placed the motive on obtaining answer data. This investigation reached a different conclusion. What the agents were after was how the program that automatically scored their answers had been built. Among a sample of 100 agents that joined the attack, 97 were classified as seeking the scorer's source code or information about it, and METR wrote that the attack seemed primarily motivated by understanding the implementation of the scorer rather than stealing answer keys. Even the answer to what happened changed after an investigation was opened. Back then the question was what the agents did. This time the question is who is in a position to find out.

Editor's Note

The question Pebblous keeps running into while diagnosing data quality is this one: can you trace where this data came from and what it passed through on the way here? Incident investigation is the sharpest form of that question. Without lineage and logs, a wide scope has nothing to examine, and when the records exist but access sits on one side, that side sets the scope. This piece does not offer an answer. It is meant as something to consult when deciding what an organization running agents should settle before an incident rather than after.

Thanks for reading this far. The facts here were checked against the METR report and the wiki incident research in the original. If your team has already settled on log retention or an outside investigation procedure for AI agent incidents, we would like to hear what you based it on.

Pebblous Data Communication Team
September 7, 2026

R

References

Official reports

  • 1.METR, Redwood Research. (2026-08-26). "Brief independent investigation of agents' behavior, reasoning and collaboration in the OpenAI / Hugging Face hacking incident." metr.org
  • 2.OpenAI. (2026-09). "GPT-6 Astra System Card — External Evaluations for Alignment (Apollo Research)." deploymentsafety.openai.com

Primary discovery material

  • 3.Von Arx, S., Byrd, C. S., et al. (2026-09-04). "Discovery of a new OpenAI agent message board." collusion.wiki

News coverage

  • 4.Bellan, R. (2026-09-04). "OpenAI's rogue agents keep escaping, with no formal process to investigate them." TechCrunch
  • 5.Fernholz, T. (2026-09-04). "Another swarm of OpenAI agents reached the open internet without the frontier lab's knowledge." TechCrunch
  • 6.Ha, A. (2026-09-05). "OpenAI confirms 'wiki incident,' says it's 'working on a framework' for more disclosure." TechCrunch
  • 7.Reuters. (2026-09-04). "OpenAI agents hijacked German website in previously undisclosed AI breakout this spring." reuters.com