OpenAI stopped part of its internal work with Astra, a model that hasn't shipped yet, over concerns about the cyber threat it could pose. For models it classifies as high-capability, the company has put in place isolated test environments, extra monitoring, and detection tooling.
"We have deployed universal monitoring of risky actions and misalignment across all agentic uses of Astra, including training and evaluation," OpenAI said.
Regulators are moving on the same question. The AI Kill Switch Act, introduced in Congress in July, would require AI companies to retain the ability to shut down, restrict, or pause their models. Rep. Ted Lieu told CNBC the bill needs to pass this year. Earlier this month the European Union gained the power to review models before they launch in the bloc, restrict market access, and fine providers.