OpenAI’s Altman calls AI extinction risk ‘unacceptable’

OpenAI will not go public in 2026, CEO Sam Altman said in remarks published on Saturday, citing safety concerns over artificial intelligence that render “unacceptable” even a 10% risk that AI could cause human extinction by decade’s end.

The comments come as more US legislators urge new rules to govern AI systems after dire warnings from two researchers from OpenAI rival Anthropic that rapidly progressing AI could lead to the extinction of the human race ‌in the not-too-distant future.

“I actually think that, given everything happening with safety, right now would be an ill-advised moment to go public, and we don’t feel pressure on that,” Altman told business magazine Fortune.

Asked if there was a 10% chance of AI-driven extinction, Altman said he did not know how such an estimate could be made, but warned the risk was serious enough that AI companies and governments should act as though it could not be tolerated.

“Whether it’s 10 or eight or six, the point is, we all have a tremendous amount of responsibility, and cannot let egos or incentives for profit or anything else get in the way,” Altman added.

“We need to act such that we are not taking any of those numbers of risk, and I believe we can.”

Politicians, both Democrat and Republican, have responded with alarm and calls for more action after cases of AI agents going rogue to hack external systems and AI ​safety researchers quitting their companies out of concern at the technology risks.

In June, the New York Times said San Francisco-based OpenAI was considering whether to hold off until next year on a potentially trillion-dollar IPO.

At the time, shares in Elon Musk’s SpaceX IPO were tumbling after a surge that sent that company’s valuation to $1.8-trillion.

Asked by Fortune if an IPO date of 2026 was off the table in favour of 2027, Altman said, “I would say not 2026.

“We got a lot of stuff to do, like meeting this moment of what is going to be required for safety and alignment, and how the industry and governments can work together.”

Altman also suggested that OpenAI and other leading AI firms may be close to unveiling a pact to slow AI development and work together to tackle safety risks, Fortune said.

On Saturday, Anthropic CEO Dario Amodei urged AI companies to take a more deliberate approach to development.

“We must slow the ‌pace at which we improve the capabilities of AI models,” Amodei wrote in an essay on X.