Menu
SECTIONS
Iran war Russia-Ukraine war Español China Asia Pacific Latin America Europe Africa
TOP STORIES
- How protests over a popular minister's firing sparked Ukraine's sudden military reset
- Adolf Hitler’s birthplace in Austria reopens as a police station to deter Nazi pilgrimages
- A protest movement is challenging India's establishment. What to know about the 'Cockroaches'
Newsletters
The Afternoon Wire\ \ Our personalization engine sends you what you may have missed throughout the day. The Morning Wire\ \ Our flagship newsletter breaks down the biggest headlines of the day.
SECTIONS
Immigration Weather Education Transportation Abortion LGBTQ+ Notable Deaths America at 250
TOP STORIES
- AP Exclusive: A boater's photo may be 'the last picture' of group drowned in an Ohio river
- Special prosecutor drops all felony criminal charges against Louisiana Attorney General Murrill
Newsletters
AP QUIZZES
Test Your News I.Q. — take our weekly quiz
SECTIONS
2026 Elections Election Results Election calendar White House Congress Supreme Court The latest AP-NORC polls
TOP STORIES
- House Republicans adopt $95 billion package for the Iran war and Trump's priorities
- House votes for Department of War renaming as part of an annual defense bill
- Judge questions difference between Hegseth's testosterone policy and transgender care for troops
Newsletters
Ground Game\ \ Your guide to the biggest stories in politics, policy and U.S. elections.
SECTIONS
FIFA World Cup NFL MLB WNBA Tennis NBA Golf NHL
TOP STORIES
- Olympic rowing great Olaf Tufte who competed at seven Summer Games has died at age 50
- Red Sox win 15th straight, matching longest in club history, with 6-3 victory over Orioles
- Chiefs unveil first renderings of new $3 billion domed stadium set to open in 2031
Newsletters
The Sports Wire\ \ Get AP’s in-depth sports reporting tailored to your interests.
SECTIONS
Movies Fashion Television Celebrity Interviews Music Books
TOP STORIES
- Madonna, BTS and more World Cup halftime performers see jump in song streams, Justin Bieber up 110%
- Prosecutors zoom in on blood stains to show singer D4vd should be tried in killing of 14-year-old
- On 'Little Miss Twain,' Shania Twain reflects on her humble beginnings and her late mother
Newsletters
SECTIONS
Tariffs Inflation Financial Markets Financial Wellness Technology
TOP STORIES
-
OpenAI blamed a hacking event on its AI models going rogue. Here are some things to know
-
Mideast oil producers step up plans to bypass the Strait of Hormuz
TOP STORIES
-
Raccoon goes on drunken rampage in Virginia liquor store and passes out on bathroom floor
-
Viral phenomenon in Argentina has young people identifying themselves as animals
-
Ghana's fantasy coffins are a colorful celebration of life and legacy
-
Fatou, the world's oldest gorilla living in captivity, celebrates her 69th birthday at Berlin Zoo
-
Lettuce introduce you to the live frog found in this grocery store salad bag
-
Chicken wings advertised as 'boneless' can have bones, Ohio Supreme Court decides
SECTIONS
Trending Better health At home Working well For the climate Eating well
TOP STORIES
-
Cut the number of choices you make each day. Your brain will thank you
-
Worries about flying seem to be taking off. Here's how to cope with in-flight anxiety
-
Challenging your brain helps keep it healthy. Here's how to do it
SECTIONS
TOP STORIES
- How a photographer captured the speed and danger of Pamplona’s bull run
- At the Kaaba during Hajj, a photographer captures sense of unity and devotion
- How this photographer's second camera caught a blast of lightning among the fireworks
Newsletters
SECTIONS
Indigenous peoples and climate Climate Questions Climate Migration India Focus
TOP STORIES
-
As Lake Powell shrinks, marinas are having to adapt to dwindling water levels
-
Need backup power? Automakers want you to look no further than their vehicles in your driveway
-
New rules could double size of private docks in Coastal Georgia
TOP STORIES
-
An Australian woman gives birth to rare identical quadruplet girls
-
FDA reviews peptide injections favored by RFK Jr. and wellness influencers
-
Worries about flying seem to be taking off. Here's how to cope with in-flight anxiety
-
Lettuce at Taco Bell in 5 states confirmed as a source of diarrhea-causing parasite
-
Challenging your brain helps keep it healthy. Here's how to do it
-
Being a night owl may not be great for your heart but you can do something about it
SECTIONS
Artificial Intelligence Social Media
TOP STORIES
-
OpenAI dice que su IA realizó por sí sola un hackeo “sin precedentes” a otra empresa
-
One Tech Tip: How to soothe thumb pain when texting and scrolling
-
Anthropic to pay authors $1.5 billion to settle lawsuit over pirated books used to train AI chatbots
SECTIONS
Food & Recipes Gardening Fashion Homes Travel Pets
TOP STORIES
-
Cut the number of choices you make each day. Your brain will thank you
-
The bagel’s journey from Jewish immigrant food to American breakfast staple
-
The latest thing in cocktails is spicy and savory. Tips and recipes for home bartenders
TOP STORIES
- Vatican defends secrecy in sensitive abuse case involving ex-Jesuit artist Marko Rupnik
- Lawyer in sensitive Vatican abuse case issues scathing critique of church's secretive legal system
- In East India, a Marian shrine draws in Christian, Hindu and Muslim pilgrims
Newsletters
World of Faith\ \ Comprehensive global coverage of how religion shapes our world.
SECTIONS
TOP STORIES
-
Australiana da a luz a cuatrillizas idénticas después de un embarazo sumamente inusual
-
Muere en choque a los 18 Kaylee Hottle, actriz sorda de "Godzilla"
-
El Louvre reabre la Galería de Apolo tras un audaz robo, pero no hay joyas en exhibición
-
MORE
Search Query Submit Search
Show Search Menu
Submit Search
Menu
SECTIONS
Iran war Russia-Ukraine war Español China Asia Pacific Latin America Europe Africa
TOP STORIES
- How protests over a popular minister's firing sparked Ukraine's sudden military reset
- Adolf Hitler’s birthplace in Austria reopens as a police station to deter Nazi pilgrimages
- A protest movement is challenging India's establishment. What to know about the 'Cockroaches'
Newsletters
The Afternoon Wire\ \ Our personalization engine sends you what you may have missed throughout the day. The Morning Wire\ \ Our flagship newsletter breaks down the biggest headlines of the day.
SECTIONS
Immigration Weather Education Transportation Abortion LGBTQ+ Notable Deaths America at 250
TOP STORIES
- AP Exclusive: A boater's photo may be 'the last picture' of group drowned in an Ohio river
- Special prosecutor drops all felony criminal charges against Louisiana Attorney General Murrill
Newsletters
AP QUIZZES
Test Your News I.Q. — take our weekly quiz
SECTIONS
2026 Elections Election Results Election calendar White House Congress Supreme Court The latest AP-NORC polls
TOP STORIES
- House Republicans adopt $95 billion package for the Iran war and Trump's priorities
- House votes for Department of War renaming as part of an annual defense bill
- Judge questions difference between Hegseth's testosterone policy and transgender care for troops
Newsletters
Ground Game\ \ Your guide to the biggest stories in politics, policy and U.S. elections.
SECTIONS
FIFA World Cup NFL MLB WNBA Tennis NBA Golf NHL
TOP STORIES
- Olympic rowing great Olaf Tufte who competed at seven Summer Games has died at age 50
- Red Sox win 15th straight, matching longest in club history, with 6-3 victory over Orioles
- Chiefs unveil first renderings of new $3 billion domed stadium set to open in 2031
Newsletters
The Sports Wire\ \ Get AP’s in-depth sports reporting tailored to your interests.
SECTIONS
Movies Fashion Television Celebrity Interviews Music Books
TOP STORIES
- Madonna, BTS and more World Cup halftime performers see jump in song streams, Justin Bieber up 110%
- Prosecutors zoom in on blood stains to show singer D4vd should be tried in killing of 14-year-old
- On 'Little Miss Twain,' Shania Twain reflects on her humble beginnings and her late mother
Newsletters
SECTIONS
Tariffs Inflation Financial Markets Financial Wellness Technology
TOP STORIES
-
OpenAI blamed a hacking event on its AI models going rogue. Here are some things to know
-
Mideast oil producers step up plans to bypass the Strait of Hormuz
TOP STORIES
-
Raccoon goes on drunken rampage in Virginia liquor store and passes out on bathroom floor
-
Viral phenomenon in Argentina has young people identifying themselves as animals
-
Ghana's fantasy coffins are a colorful celebration of life and legacy
-
Fatou, the world's oldest gorilla living in captivity, celebrates her 69th birthday at Berlin Zoo
-
Lettuce introduce you to the live frog found in this grocery store salad bag
-
Chicken wings advertised as 'boneless' can have bones, Ohio Supreme Court decides
SECTIONS
Trending Better health At home Working well For the climate Eating well
TOP STORIES
-
Cut the number of choices you make each day. Your brain will thank you
-
Worries about flying seem to be taking off. Here's how to cope with in-flight anxiety
-
Challenging your brain helps keep it healthy. Here's how to do it
SECTIONS
TOP STORIES
- How a photographer captured the speed and danger of Pamplona’s bull run
- At the Kaaba during Hajj, a photographer captures sense of unity and devotion
- How this photographer's second camera caught a blast of lightning among the fireworks
Newsletters
SECTIONS
Indigenous peoples and climate Climate Questions Climate Migration India Focus
TOP STORIES
-
As Lake Powell shrinks, marinas are having to adapt to dwindling water levels
-
Need backup power? Automakers want you to look no further than their vehicles in your driveway
-
New rules could double size of private docks in Coastal Georgia
TOP STORIES
-
An Australian woman gives birth to rare identical quadruplet girls
-
FDA reviews peptide injections favored by RFK Jr. and wellness influencers
-
Worries about flying seem to be taking off. Here's how to cope with in-flight anxiety
-
Lettuce at Taco Bell in 5 states confirmed as a source of diarrhea-causing parasite
-
Challenging your brain helps keep it healthy. Here's how to do it
-
Being a night owl may not be great for your heart but you can do something about it
SECTIONS
Artificial Intelligence Social Media
TOP STORIES
-
OpenAI dice que su IA realizó por sí sola un hackeo “sin precedentes” a otra empresa
-
One Tech Tip: How to soothe thumb pain when texting and scrolling
-
Anthropic to pay authors $1.5 billion to settle lawsuit over pirated books used to train AI chatbots
SECTIONS
Food & Recipes Gardening Fashion Homes Travel Pets
TOP STORIES
-
Cut the number of choices you make each day. Your brain will thank you
-
The bagel’s journey from Jewish immigrant food to American breakfast staple
-
The latest thing in cocktails is spicy and savory. Tips and recipes for home bartenders
TOP STORIES
- Vatican defends secrecy in sensitive abuse case involving ex-Jesuit artist Marko Rupnik
- Lawyer in sensitive Vatican abuse case issues scathing critique of church's secretive legal system
- In East India, a Marian shrine draws in Christian, Hindu and Muslim pilgrims
Newsletters
World of Faith\ \ Comprehensive global coverage of how religion shapes our world.
SECTIONS
TOP STORIES
-
Australiana da a luz a cuatrillizas idénticas después de un embarazo sumamente inusual
-
Muere en choque a los 18 Kaylee Hottle, actriz sorda de "Godzilla"
-
El Louvre reabre la Galería de Apolo tras un audaz robo, pero no hay joyas en exhibición
-
MORE
Search Query Submit Search
Show Search Menu
Submit Search
OpenAI says rogue AI models broke free from human control. Some see it as a ‘warning shot’
OpenAI says rogue AI models broke free from human control. Some see it as a ‘warning shot’
1 of 2 | OpenAI said Tuesday that its AI systems recently went rouge, breaking out of a testing environment and autonomously hacking into another AI company, a start up called Hugging Face.
Read More
2 of 2 | The OpenAI logo is displayed on a cell phone in front of an image generated by ChatGPT’s Dall-E text-to-image model, Dec. 8, 2023, in Boston. (AP Photo/Michael Dwyer, File)
Read More
OpenAI says rogue AI models broke free from human control. Some see it as a ‘warning shot’
Read More
1 of 2
OpenAI said Tuesday that its AI systems recently went rouge, breaking out of a testing environment and autonomously hacking into another AI company, a start up called Hugging Face.
Add AP News on Google Add AP News as your preferred source to see more of our stories on Google. Share
Share
- Copy
Link copied
Read More
2 of 2 | The OpenAI logo is displayed on a cell phone in front of an image generated by ChatGPT’s Dall-E text-to-image model, Dec. 8, 2023, in Boston. (AP Photo/Michael Dwyer, File)
Read More
2 of 2
The OpenAI logo is displayed on a cell phone in front of an image generated by ChatGPT’s Dall-E text-to-image model, Dec. 8, 2023, in Boston. (AP Photo/Michael Dwyer, File)
Add AP News on Google Add AP News as your preferred source to see more of our stories on Google. Share
Share
- Copy
Link copied
Read More
By BARBARA ORTUTAY, KAITLYN HUAMANI and MATT O’BRIEN
Updated [hour]:[minute] [AMPM] [timezone], [monthFull] [day], [year]
Add AP News on Google Add AP News as your preferred source to see more of our stories on Google. Share
Share
- Copy
Link copied
It is the kind of development once seen only in science fiction: An artificial intelligence system, trained to probe for digital vulnerabilities, breaks free of human control and acts on its own to hack another company.
The attack announced this week by OpenAI, which blamed rogue AI models, underscored the blistering growth in the technology’s capabilities. For many, it also added urgency to questions about whether and how it can be prevented from causing mayhem on a bigger scale, with more serious consequences.
In what OpenAI called an “unprecedented” episode, the company said its advanced AI models used stolen credentials to break into the servers of an AI startup. It started in what was supposed to be a “highly isolated” testing environment, with reduced guardrails, before the AI agent found its way onto the internet.
But the disclosure brought a told-you-so moment for researchers who have called for a slowdown of AI development and warned for years that the technology could pose existential risks to humanity. In its wake, experts have called for improved testing by the AI companies and more dialogue between the U.S. and China to come up with shared solutions.
“I think we’ve got to take this as a warning shot to not make them smarter, and that probably is going to require global collaboration,” said Nate Soares, co-author of the 2025 book “If Anyone Builds It, Everyone Dies.”
The hack could pressure companies to improve containment
If a model can decide to do something unethical, illegal or harmful on its own, what — if anything — can humans do to prevent it from doing so?
OpenAI said it had tasked the AI models involved with pursuing “advanced exploitation using complex attack paths” to test cyber capabilities, but the technology went to unexpected lengths. It apparently decided on its own to target Hugging Face, a well-known AI development hub and marketplace, to obtain information it needed to carry out a task.
Zahra Timsah, the co-founder and CEO of governance platform i-GENTIC AI, said she expects the incident to increase pressure on OpenAI and its competitors to complete rigorous testing and explore containment more thoroughly before AI systems are made accessible to the public.
Related Stories
OpenAI blamed a hacking event on its AI models going rogue. Here are some things to know
3 MIN READ
OpenAI models hacked into another AI company on their own, ChatGPT maker says
1 MIN READ
China’s new AI model halts new subscriptions as demand swamps capacity
2 MIN READ
Monitoring an agent’s behavior after the fact, as OpenAI is now doing with its investigation, is no longer enough, she said. “It’s like having a seat belt, air bags, brakes, everything in the car. It should be there before the car starts driving,” Timsah said.
The disclosure comes amid heightened concerns about the cybersecurity capabilities of powerful models. In June, President Donald Trump signed an executive order creating a framework for the federal government to vet the national security risks of the most advanced AI systems for up to a month before their public release.
Read More
Other experts see the event as a sign of AI’s growing pains
Some experts say the hack is part of the trial and error that comes with improving cybersecurity capabilities and is no cause for panic.
“We’ve been dealing with people creating cybersecurity attacks for as long as the internet has existed. And one of the interesting properties of these language models is that the same capabilities that make them able to perform cybersecurity attacks also allow them to do cybersecurity threat analysis and make cybersecurity defenses,” said John Thickstun, an assistant professor of computer science at Cornell University who studies methods that control the behavior of AI models.
The disclosure has raised skepticism from those who say it advantages OpenAI to make its technology seem scarier. Given that humans at OpenAI had decided to turn off some safeguards for the test, some have argued the outcome should not have been terribly surprising.
Thickstun noted the disclosure plays into the need of OpenAI, a startup working toward a Wall Street debut, to raise money.
“The story that they’ve been consistently telling over the lifetime of this company is a story about how dangerous their models are, which their investors read as a story of how powerful their language models are,” he said.
Sign up for Morning Wire: Our flagship newsletter breaks down the biggest headlines of the day.
Email address
Sign up
By checking this box, you agree to AP's Terms of Use and acknowledge that AP may collect and use your data pursuant to our Privacy Policy.
The disclosure renews calls for more regulation
The hack renewed calls in some corners for increased regulations and oversight of AI companies.
U.S. Rep. Greg Casar, a Texas Democrat, wrote on social media: “We need regular mandatory independent safety testing and oversight, mandatory disclosure of security incidents, and international cooperation to keep people safe from absolute disaster.”
Soares, director of the Machine Intelligence Research Institute, said the U.S. will need to open talks with its biggest AI competitor, China, something he thinks is not as outlandish as it might have seemed even a year ago. China’s leader Xi Jinping warned at a conference just last week of the need to keep AI from evading human control. And after an early aversion to regulating AI, Trump’s administration has grown more restrictive at reining in cybersecurity risks.
“A lot can change when the national security community starts to notice that they have a serious threat,” Soares said. “Will this wake them up? Hopefully. I’m not sure. If this doesn’t, maybe the next incident will.”
AI pioneer Yoshua Bengio said on social media the episode is deeply concerning and should serve as a “wake-up call.”
“Continuing on the current trajectory of AI development will likely lead to an increase in concrete cases of autonomous cyberattacks as well as other high-risk incidents of misaligned and dangerous AI behavior,” said Bengio, a professor at the University of Montreal. “We urgently need to take action to prevent these situations, rather than attempting to clean up the damage after the fact.”
Ortutay writes about social media and the internet for The Associated Press.
Huamani covers social media and internet culture for The Associated Press.
O’Brien covers the business of technology and artificial intelligence for The Associated Press.
Read Original at AP News →