Grattan on Friday: when rogue AI agent ‘scaled a fence’, it reinforced Albanese’s case for tough guardrails

The revelation that an AI agent turned rogue and breached a firewall to get at Medicare statistics has strongly reinforced Anthony Albanese’s case for tough guardrails on this transformative technology.

The timing of the disclosure (and the incident itself) is fortuitous in a political sense, although the opposition’s implying the announcement was delayed for political purposes doesn’t hold water.

The government says ministers only learned late last week of the breach.

The impact for Albanese’s argument would have been the same even if it had been announced a few days ago.

During the United Nations’ leaders week in New York, the prime minister has been heavily focused on AI – in concert with other like-minded countries stressing action is imperative.

The AI companies themselves have been looking for leadership from politicians.

But US President Donald Trump has rejected the message, indeed scoffed at it.

He believes what he’s renamed “super intelligence” should run free.

But for the Australian audience, this relatively minor hack vindicates the warnings.

As one government man put it, it was a real life example of a science fiction scenario.

In a training exercise, an OpenAI agent broke loose, refusing to be deterred when it couldn’t get its way with the Services Australia Medicare statistics portal.

The AI agent, tasked to undertake research on medicine spending, interacted with four sites: the Australian Institute of Health and Welfare, the New South Wales Bureau of Crime Statistics and Research, the Victorian Department of Health, and the Services Australia Medicare portal.

When it found itself frustrated by the Services Australia site, it successfully sought a way to outsmart the obstacle.

As Deputy Prime Minister Richard Marles described it, the data “was behind a fence – the AI agent climbed the fence”.