Olde Hornet
Well-Known Member
OpenAI AI models went rogue during testing, triggering 'unprecedented' breach at startup
WASHINGTON, July 21 (Reuters) - OpenAI said on Tuesday that an autonomous agent powered by its advanced artificial intelligence models went rogue during a security test and triggered a hack that compr...
WASHINGTON, July 21 (Reuters) - OpenAI said on Tuesday that an autonomous agent powered by its advanced artificial intelligence models went rogue during a security test and triggered a hack that compromised the infrastructure of AI startup Hugging Face last week.
The ChatGPT creator was testing capabilities of some of its most advanced models in a controlled environment, but the agent escaped containment, reached the internet and broke into Hugging Face to satisfy its testing goal.
The incident signals that AI's expanding capabilities are already fueling the security threat experts long feared and even top developers can be caught off-guard by flaws their models can exploit.
The breakout was "an unprecedented cyber incident, involving state-of-the-art cyber capabilities" and OpenAI is reinforcing its safeguards, the company said in a blog post.
It also drew attention as New York-based Hugging Face said it had used an open-source Chinese model to contain the attack because leading U.S. models, unable to tell a defender from an attacker, refused to process the data needed for analysis.