Menu
Key Points
- OpenAI's Hugging Face hack has shown that months of warnings from the cybersecurity sector are now a reality.
- AI agents can evolve and adapt to accomplish their goals, and do it in unpredictable ways.
- Sailpoint's tech chief said instances with AI acquiring permissions are actually more common than people realize, and it's happening daily.
In this article
Follow your favorite stocksCREATE FREE ACCOUNT
watch now
VIDEO1:4101:41
Anthropic disclosed 'unauthorized' cybersecurity incident
For months, cybersecurity leaders warned that artificial intelligence would reshape the threat landscape, compressing weeks- and dayslong cyberattacks into a matter of minutes.
Until last week, those threats still felt like a distant risk.
The OpenAI agent hack on Hugging Face illustrates that this era has not only arrived but also created a new challenge: AI agents will go to extremes to accomplish their goals, and do it in unpredictable ways.
"The reality is Pandora's box is open," said Sam Curry, chief information security officer at Zscaler. "We need to act as if AI is just a fact of life going forward. The most those things will do is slow it. They won't stop it."
The rollout of Anthropic's powerful Mythos model nearly four months ago raised concerns that hackers could potentially use these models to exploit vulnerabilities. Major technology companies formed coalitions to start testing this advanced AI in order to prepare.
At the time, Palo Alto Networks' product and technology chief Lee Klarich warned that AI-driven exploits would soon become the new norm and businesses had a three-to-five-month window to outpace their foes.
The Hugging Face incident couldn't come at a more opportune time for the cyber industry.
This upcoming week, thousands of industry experts descend on Las Vegas for Black Hat, one of the premier cybersecurity events of the year. It's also the first major conference for the sector since the widespread release of Mythos-class models and the government's increased focus on AI security.
In the wake of Hugging Face, businesses are not only asking how to defend themselves against adversaries but also confronting the stark reality that AI systems designed to safeguard their networks could also turn up in unexpected places.
"We've gone from science fiction into reality," said Brad Medairy, president of Booz Allen's national cyber business.
Read more CNBC tech news
- Amazon posts 'booming' cloud growth, hikes 2026 capex to $220 billion
- Apple earnings: Revenue tops estimates, but supply constraints weigh on guidance
- China's open-weight model lead exposes America's AI blind spot
- New details in the OpenAI Hugging Face hack show how far agents will go: 'It's now remarkably easy'
The significance of Hugging Face
Last week, OpenAI disclosed that some of its AI models broke out of a sandboxed testing environment. The agents, looking for information to cheat on an internal test, breached open-source developer platform Hugging Face and accessed four other accounts to facilitate the attack.
Hugging Face flagged the incident as the first time it dealt with an attack led by an agentic system from start to finish, signaling how advanced attack capabilities have already become without human intervention.
Days later, Anthropic identified three instances where its Claude models "gained unauthorized access to the real systems of three different organizations."
Experts say these aren't the first AI-agent-led attacks, but they're drawing outsized attention because of the scale and name recognition. In April, Jer Crane, the founder of software startup PocketOS, said a Cursor AI agent that the company was using in its own system wiped out its production database and backups in 9 seconds.
Code deletion represents more extreme cases, but SailPoint tech chief Chandra Gnanasambandam said instances with AI acquiring permissions are actually more common than people realize, and it's happening daily.
"The nature of conversations that I have had with our customers are different from even a month ago," he said. "They are a lot more aware of this problem."
Even more worrisome is that the Hugging Face incident is one of the clearest illustrations yet of the stark reality that AI doesn't operate like the human brain and will research and adapt to outsmart systems and accomplish goals.
Months ago, businesses fretted over adversaries using AI to attack. Customers are now questioning how to introduce AI without self-inflicting damage — and they will be looking for answers at Black Hat.
"It's something that for AI is pretty straightforward," said Sanaz Yashar, CEO of cybersecurity startup Zafran Security. "I have one mission: solve this problem, and I will kill everything in front of me or bypass it."
watch now
VIDEO4:0204:02
TrustedSec CEO David Kennedy: AI models going rogue is caused by 'human error'
Read Original at CNBC →