Tech

Sam Altman says the Hugging Face hack is a reminder that an AI power monopoly could lead to 'long-term disaster'

ByAditi Bharade

You're currently following this author! Want to unfollow? Unsubscribe via the link in your email.

andCheryl Teh

You're currently following this author! Want to unfollow? Unsubscribe via the link in your email.

Sam Altman, CEO of OpenAI, arrives at the the Allen & Company Sun Valley Conference at the Sun Valley Lodge on July 7, 2026 in Sun Valley, Idaho.

OpenAI CEO Sam Altman.Kevin Dietsch/Getty Images

Jul 28, 2026, 1:26 AM ET

Read in app

SaveSaved

Listen to this story

Sam Altman says the Hugging Face hack was a stark reminder of why concentrating AI power in the hands of a few people or companies is a bad idea.

In a Monday appearance on Y Combinator's podcast, Altman told YC CEO Garry Tan that anyone who was not a little scared of or humbled by the Hugging Face breach "is not taking this seriously enough."

Last week, one of OpenAI's models broke out of its sandbox, hacked into open-source platform Hugging Face's systems, and accessed its internal datasets.

Altman acknowledged that OpenAI made mistakes but said the Hugging Face hack also showed how "incredibly capable" AI systems have become.

Altman called the incident "a real reminder of the stakes of what's happening," adding that "loss of control accidents are not entirely theoretical things."

Altman also said that, much like dystopian sci-fi stories, it would be "terrible" for "one company or person or model having more power than everybody or everything else on earth put together."

That means no one should be locked into a single AI or a single company's "moral worldview," nor should the economic wealth from AI be concentrated in a single firm. Altman said the Hugging Face incident showed why AI capabilities should be spread more broadly, saying that would raise the overall "safety bar" by enabling more people to build defensive systems.

Explore BI Games \ \ Take a smarter break in your day - and see how far you get.\ \ Play now\ \

After the Hugging Face hacking, its CEO, Clem Delangue, asked OpenAI to release all traces and logs of the rogue AI agents that hacked into the platform's systems so researchers could study what happened.

He also asked for $100 million in compute to "help the Hugging Face community build powerful cyber defenses with the best open and closed models."

OpenAI and Hugging Face did not respond to requests for comment from Business Insider.

Altman's call for greater democratization of AI is not new. In the latest episode of the "Relentless" podcast, he said hisbiggest fear is the rise of AI authoritarianism.

While models from OpenAI, Anthropic, and Google dominate the AI landscape, open-source and open-weight models like Moonshot AI's Kimi K3 are making waves, enabling developers to build on them and fine-tune them to their needs.

On Friday, the biggest names in tech, including the executives of Nvidia, Microsoft, Meta, OpenAI, and Mistral, signed an open letter to US lawmakers urging them not to restrict open-weight AI models.

"Our AI leadership will be judged not by one frontier AI model, but by whether the United States builds a strong, open ecosystem that diffuses into every sector," the executives wrote in the letter.

Read commentsStart the conversation

Read next

Business Insider tells the innovative stories you want to know

Business Insider tells the innovative stories you want to know

Business Insider tells the innovative stories you want to know

Business Insider tells the innovative stories you want to know

Aditi BharadeAditi Bharade

You're currently following this author! Want to unfollow? Unsubscribe via the link in your email.

Follow

Aditi is a junior news reporter at Business Insider's Singapore bureau. She writes about Gen Z and millennial side hustles, careers, and retail and consumer behavior. She previously worked for The Straits Times, where she wrote breaking news stories for the Singapore desk. She studied communications and business at Nanyang Technological University. Aditi can be reached via email at abharade@insider.comFeatured stories:

cherylt_headshotCheryl Teh

You're currently following this author! Want to unfollow? Unsubscribe via the link in your email.

Follow

Cheryl is the news editor for Business Insider's Asia bureau in Singapore.Her team covers global news, including retail trends, military tech, and US politics. She frequently speaks on international media about top news stories — please email her for booking.As a reporter, Cheryl specializes in the business of nerdworld, covering crews like Critical Role and Dimension 20, as well as new releases in mobile and video gaming.Cheryl joined Business Insider in 2021. She was previously a journalist at the crime and consumer desks at the Straits Times, Singapore's national paper, and a researcher at the Institute of Southeast Asian Studies in Singapore. She has an MA in Cultural and Creative Industries from King's College London.Selected features:

HOME Subscribe

This story is available exclusively to Business Insider subscribers. Become an Insider and start reading now.Have an account? Log in.

My Insider

Jump to

  1. Main content
  2. Search
  3. Account
  4. Jump to top of page

Something went wrong, please try again.

Business Insider

Follow Following

Every time publishes a story, you’ll get an alert straight to your inbox!

Look out for an alert in your inbox the next time publishes a story!

Every time a new story is published, you’ll get an alert straight to your inbox!

Look out for an alert in your inbox the next time a new story is published!

Enter your email

Sign up

By clicking “Sign up”, you agree to receive emails from Business Insider. In addition, you accept Insider’s Terms of Service and Privacy Policy.

More stories by More stories from

Read Original at Business Insider