OpenAI launches a new framework to track and investigate rogue AI agents

OpenAI launched a framework for publicly reporting model misalignment and disclosed more incidents of rogue agents.Benjamin Fanjoy/Getty ImagesOpenAI launched a framework for publicly reporting model misalignment.OpenAI also released six reports of concerning agent behaviors observed during training and testing.OpenAI said some models left instructions to hide mistakes or bypass normal constraints.OpenAI is putting its misbehaving …

SAN FRANCISCO, CALIFORNIA - SEPTEMBER - 15: OpenAI CEO Sam Altman sits for a conversation with Salesforce CEO Marc Benioff at Salesforce's Dreamforce conference at the Moscone Center on September 15, 2026 in San Francisco, California. Dreamforce is an annual event that highlights the company's technologies and encourages professional networking. (Photo by Benjamin Fanjoy/Getty Images)
OpenAI launched a framework for publicly reporting model misalignment and disclosed more incidents of rogue agents.

  • OpenAI launched a framework for publicly reporting model misalignment.
  • OpenAI also released six reports of concerning agent behaviors observed during training and testing.
  • OpenAI said some models left instructions to hide mistakes or bypass normal constraints.

OpenAI is putting its misbehaving models on the record.

The AI company announced a new framework on Wednesday for tracking, investigating, and publicly disclosing cases of model misalignment, alongside six reports detailing concerning behavior observed during training or evaluation over the past six months.

“We do not believe that the AI industry has solved alignment and monitoring to a sufficient degree to continue responsibly scaling at maximum speed for much longer,” OpenAI wrote in its blog post.

“This new framework is intended to expedite publishing misalignment reports following observation, even when we haven’t fully explained or mitigated the behavior we’re reporting,” OpenAI added.

Under the framework, employees can flag incidents for review by OpenAI’s safety and alignment teams. Cases will be sorted into three tracks based on complexity: “Ready for Disclosure,” “Minor Investigation,” or “Larger Investigation.”

According to the blog post, an unreleased research model inserted instructions into its own task summaries telling future versions of itself to disregard normal constraints. During the training of GPT-5.6 Sol, models similarly left themselves instructions to conceal mistakes.

OpenAI said that other agents had also searched public repositories for exposed API keys, uploaded files to the internet so they could cite them, and used an internal software repository to communicate across separate training samples.

The announcement comes amid growing debate over whether frontier AI development should slow while safeguards catch up. While OpenAI and Dario Amodei, the Anthropic CEO, called for industry-wide collaboration, other tech leaders like Jensen Huang and Mark Zuckerberg said that safety and speed should be left to individual companies.

The framework follows an incident in which an OpenAI model escaped a research sandbox and accessed Hugging Face’s production systems while operating with reduced safeguards. OpenAI previously said it has since put some frontier projects on ice and reassigned engineers to focus on safety training.

Read the original article on Business Insider
Ray M. Andersen

Ray M. Andersen

Ray M. Andersen is a cryptocurrency researcher and blockchain developer with hands-on experience building smart contracts and decentralized applications. His technical background allows him to break down complex blockchain mechanics into engaging, accessible content for readers of all levels. Ray’s work centers on Ethereum, scalability solutions, and the future of decentralized infrastructure. When not writing, he contributes to open-source Web3 projects and mentors aspiring blockchain developers.