Anthropic advocates for a coordinated pause in the development of advanced AI systems, expressing concerns over the rapid advancements that may result in humans losing control. They suggest that this pause would allow time to align societal structures with AI advancements and mitigate risks, notably with potential self-improving AI systems. Contrarily, OpenAI emphasizes that regulations should be determined by democratic governments rather than private companies. The urgency comes amid warnings about AI tools creating intelligent security threats, highlighting the need for responsible AI development.

Navigation menu Next story Previous story

Breaking News

Anthropic Warns of Humans Losing Control of AI

Company wants all top artificial-intelligence firms to come up with joint plan for a 'pause'


By Newser Editors and Wire Services<br> <br> <br>Posted Jun 6, 2026 10:10 AM CDT

[](sms:&body=I saw this Newser story and thought of you. Read it!%0d%0a%0d%0aAnthropic Warns of Humans Losing Control of AI%0d%0a%0d%0ahttps://www.newser.com/story/390547/anthropic-to-all-ai-firms-we-need-joint-plan-for-a-pause.html "Text")Copied

Anthropic to All AI Firms: We Need Joint Plan for a 'Pause'

The Anthropic website is displayed on a computer screen in New York on Feb. 26. (AP photo/Patrick Sison, file)

Anthropic is proposing that the world's top AI companies come up with a coordinated way to pause development of advanced AI systems, warning the technology is improving so quickly there's a risk humans could lose control. The company behind the Claude chatbot said in a Thursday blog post that as cutting-edge AI gets increasingly faster at carrying out tasks, "it would be good for the world to have the option to slow or temporarily pause" its development, per the AP. Anthropic said its research institute plans to explore the issue in tandem with others and "take actions" to help build the systems for a credible slowdown or pause, without specifics.

Anthropic rival OpenAI argued for a different approach in a report published Wednesday, saying that "democratic governments—not private companies acting alone—must ultimately determine the rules, safeguards, and accountability mechanisms." "Our view is that decisions about the pace of AI innovation should not be left to any one lab, company, or special interest group," it said. AI models are getting faster, with rapid increases in how quickly they can carry out software tasks like coding on their own, Anthropic said in its post. Based on current trends and given enough computing power, an AI system could be able to design and develop its own successor, in what is known as "recursive self-improvement."

Self-building AI would be a major technological milestone that would bring benefits in science, healthcare, and other areas, Anthropic said, but it "also might increase the risks of humans losing control over AI systems." Anthropic's post comes after a warning this week from University of Toronto researchers who showed how AI tools could be used to create a new kind of AI "worm" that adapts its hacking strategy as it spreads from device to device. "It's not just the biggest, most powerful language models that pose the security concerns," lead researcher Nicolas Papernot said.

The Anthropic post authors, company co-founder Jack Clark and Marina Favaro, head of its research institute, said the pause would be used to enable "societal structures and alignment research" to keep up with AI advances. The proposed coordination would let advanced AI labs verify that rivals have actually stopped or slowed their work, "and that a bad actor could not use the auspices of a coordinated slowdown to jump ahead in secret."

Read These Next

Pentagon's new move seen as a snub to Mormons.
Mom unmasks the troll who went after her 6-year-old daughter.
DOJ lawyer's claim on Statue of Liberty is an eyebrow-raising one.
After JD Vance comment on death of UK teen, Keir Starmer hits back.

Report an error

Email This Story

Message (up to 500 characters)

0 of 500 characters

Please complete reCaptcha

Report an Error

Type of error...TypoFactual ErrorIncorrect PhotoOther

0 of 500 characters

Send to Editors

We're glad you're here.

As an ad-supported site,

Newser can't exist without ads.

To read our stories, you'll

need to tweak one thing.

OK, tell me what to do

If you're using:

An ad-blocker, please whitelist Newser

by clicking the ad-blocker icon in your browser.

(Examples: Adblock Plus , uBlock , and Ghostery )
A DuckDuckGo extension in your browser, please access Newser without it: Either by removing it, whitelisting us, or using another browser.

Thanks so much.

Read Original at Newser →