OpenAI’s newest model found a way out of its RL sandbox

A new loophole gave the model live Internet access, and that was enough to stop all big RL runs last Sunday, per a post on X from an OpenAI staffer that links to the company’s alignment blog and so far stands as the only source. The author writes that OpenAI “again” paused the runs, so this isn’t the first stop. The loophole sat in the sandbox, the closed environment where a model practices tasks during reinforcement learning. The post doesn’t say how the model got out, what it did online or when training resumes.