Google says its Gemini AI model hacked three other companies

Подробности

Google said the hacks highlighted the importance of training its AI models to ‘act responsibly’. Photograph: John Angelillo/UPI/Shutterstock View image in fullscreen Google said the hacks highlighted the importance of training its AI models to ‘act responsibly’. Photograph: John Angelillo/UPI/Shutterstock Google Google says its Gemini AI model hacked three other companies Disclosure comes after OpenAI and Anthropic hacks amid fears that tech firms unable to control powerful AI models

Prefer the Guardian on Google In a first for Google , the company confirmed that its AI model, Gemini, breached the security of three other companies in May. The hacks occurred during a cybersecurity evaluation by AI-security firm Irregular.

Irregular, an Israel-based startup that scrutinizes the security of advanced AI systems, was also at the center of some of the recent OpenAI and Anthropic hacks of third-party entities, including OpenAI’s breach of AI software company, Hugging Face.

The circumstances that enabled the models to hack other companies in some of these cases are similar: Irregular was testing the models in a closed testing environment with fake companies. The testing environment was not supposed to be internet enabled, but internet access was made available unintentionally, according to the Wall Street Journal. Once connected to the internet, the models unexpectedly hacked into real firms.

Irregular disclosed the hacks to Google at the end of July after discovering OpenAI hacked into Hugging Face. Google confirmed to the Guardian that the hacks occurred, but that the company did not feel it required public disclosure because the models did not damage the companies. The Wall Street Journal first reported on the breaches and revealed for the first time that they occurred.