Comment Loader Save StorySave this story
Comment Loader Save StorySave this story
On July 25, Jeff Dean spoke to 6,000 would-be founders at Y Combinator’s Startup School at San Francisco’s Chase Center. Dean is a legendary engineer at Google. He is cofounder of Google Brain, chief scientist of Google DeepMind and Google Research, and technical colead on the company’s flagship AI model Gemini. With his frequent collaborator Sanjay Ghemawat, he’s written significant parts of the company’s computing and search infrastructure. A running joke in geekdom is a list of surreal “facts” about his technical prowess: Jeff Dean’s resume lists the things he hasn’t done; it’s shorter that way. At Chase Center, the interviewer asked him what areas startup founders should think about tackling.
Dean said that the most important thing would be to pick something you’re excited about and would be useful in the world. He then shared his own interest: an automated version of the scientific method. “You propose an experiment, you implement what you need to run the experiment, you evaluate the experiment, and then you get results from that,” he said. Dean said that running thousands of those automated loops could unlock groundbreaking advances in multiple domains like science, biology, chip design, and even making improved AI models.
Unbeknownst to the crowd, Dean was talking about his own secret startup, which he had just organized. Today it’s official: After almost 27 years, Dean is leaving Google, along with Ghemawat and two other top-tier AI scientists, to found a company called Discovery Loop.
Even though Google will take a stake in the new company, it’s a devastating blow to the search giant as it attempts to keep pace in the frantic AI model competition. It’s bad enough that Dean and Ghemawat, who were among the company’s first hires, are leaving—that’s like Mick Jagger and Keith Richards ditching the Rolling Stones to start a new band. Worse, the other cofounders are also supernovas in the AI firmament: Oriol Vinyals, VP of research at DeepMind and a technical lead for Gemini, and Quoc Le, a cofounder of Google Brain and the key scientist behind Google’s AutoML-Zero, a project that uses machine learning algorithms to autonomously build AI products.
In an interview I did with the cofounders just before launch, Dean tells me the idea came up only a few weeks ago. He was quickly joined by the other three, who are not only long-time colleagues but friends who vacation together. “We were working on different things, but we were all starting to see the possibility of AI being able to automate scientific and engineering loops,” he says.
The quartet worked up a road map wherein Discovery Loop would be its own first customer. The autonomous experiment loops they create initially will be directed towards improving the company’s advanced machine learning algorithms. That improved software will then become the core of an AI system that can tackle problems in subsequent domains. “I’m very excited about automating machine learning,” says Le. “It might be that we will discover a different transformer architecture.”
From there, Discovery Loop will set out to make superhuman advances in a variety of fields, including chip design, biology, drug discovery, and material design. “As we create the core intelligence and the discovery loop fundamentals, we'll be able to quickly generalize to other domains,” says Vinyals. “One of the things that we'll be obviously very focused on is how these models come up with new ideas to try. That's not something that currently they're super strong at.”
At first, the team envisions that those ideas will be codeveloped with humans, but their goal is deeply automating the process. If it works out, they contend, it’s possible that a few dedicated individuals may use Discovery Loop to out-invent the world’s largest research organizations. Presumably those small teams will be customers of Discovery Loop. (The startup also may make its own loops to seek and monetize breakthroughs.)
They put together a simple pitch deck and set out to talk to VCs about funding their company, which they set up as a public benefit corporation. “We just put a few slides with our backgrounds and a rough sketch of how we think our approach will be successful in a bunch of different ways,” says Dean. (They didn’t use AI to create it.) But their presence spoke louder than any PowerPoint could.
“With this team, I wouldn’t need to know what they were doing before I backed them,” says venture capitalist Vinod Khosla, who met with them in his Sand Hill Road office on a Saturday, so no one would get a hint of Google’s upcoming loss. “It’s the ultimate superstar team.” Khosla also loved their idea: “Humans have been using AI to do research, not using AI to be a researcher,” he says. “The fundamental thing [in Discovery Loop] is that AI is the researcher.”
Other meetings took place at Dean’s house. Ultimately Khosla Ventures and an AI-oriented VC firm called Radical Ventures bought in, along with a handful of other firms. (The founders aren’t sharing how much the funding was and at what valuation–but consider that some companies are paying tens or even hundreds of millions for a single AI superstar, and these guys are GOATs.) “Building something to solve all those problems is a powerful idea,” says Radical managing partner Jordan Jacobs, who will join the startup’s board. “These people have been doing this kind of work in the past so they know what they’re doing.”
Negotiating the exit from Google was more painful. Dean says that Alphabet CEO Sundar Pichai tried over multiple meetings to get them to keep their badges. Ultimately the team decided that they wanted the fun–and the freedom–of doing a startup.
“In a large organization there is always a lot of inertia you have to overcome to make any radical changes,” says Vinyals. “We want to build something different.” Google ultimately gave the departing engineers its blessing, along with an investment and an arrangement to provide compute power for the first year.
“Over 27 years, Jeff and Sanjay helped to drive some of the most significant technology transitions, from our early search infrastructure to the neural networks that helped create the modern AI era,” Pichai said in a statement. “We’ll continue to work with Discovery Loop as a founding investor and Cloud partner, and collaborate on a research framework for ML systems and related infrastructure advances.”
In part because of the impact this mini-exodus will have on Google. Dean and his cofounders have taken pains to maintain stealth. To date, they haven’t yet begun to hire a team (which may mean even more defections from Google) or even to rent office space. When I ask who the CEO is, there is a brief pause. “I think I’m the CEO,” says Dean, sheepishly. “Everyone pointed at me.”
Discovery Loop’s mission is not novel. Just about every major figure in AI— Dario, Sam, Jensen—has claimed at one point or another that AI will become an engine of scientific discovery, solving problems that humans could never crack on their own. This team is betting that their knowledge and skills will prevail in building a system that actually makes such breakthroughs. Short of that, Discovery Loop faces a narrower mark for success: Will the work they do as a startup be as significant as the talent gap they’re creating by leaving Google?
Comments
Join the discussion
Comments
You Might Also Like
-
In your inbox: Inside WIRED’s newsroom with Katie Drummond
-
YouTube and X have become ‘gateways’ to nudify apps
-
Big Story: For Taylor Swift, MSG’s controversial cameras briefly went dark
-
Pete Hegseth’s plan for ‘high T’ troops is a junk-science fever dream
-
How to find us: Add WIRED.com to your preferred sources in Google
Steven Levy covers the gamut of tech subjects for WIRED, in print and online, and has been contributing to the magazine since its inception. His writes Backchannel, a weekly newsletter that puts the biggest tech stories in perspective. He has been writing about technology for more than 30 years, writing ... Read More
Editor at Large
Topics Google artificial intelligence machine learning Startups Silicon Valley
I Built a Self-Improving AI, and So Can You
Experiments in using AI to build AI show that the future doesn’t just belong to the frontier labs.
Will Knight
An Inventor of Apple’s FaceID Wants to Analyze Your Brain’s Health With AI
Gidi Littwin’s new AI startup, Hemispheric, makes diagnostic brain scans for conditions like depression, PTSD, and Parkinson’s. He wants the technology to be as cheap and easy as for a blood test.
Isabella Ward
LinkedIn Won’t Be Expanding Its Data Centers in the Next Year
Despite the ongoing AI boom, LinkedIn is holding the line on compute spending. Instead, it’s challenging engineers to make every GPU count.
Paresh Dave
Thinking Machines Lab Drops Its First Model
Inkling, a 975-billion-parameter open source model, was trained to understand video and audio. It could help Thinking Machines establish itself among competitors like Anthropic and OpenAI.
Will Knight
Scientists’ Side Hustle? Using AI and Quantum Computing to Generate New Peptides
Researchers cobbled together funding and time to show how quantum computing could aid in the development of drugs to help underserved populations and combat rare diseases.
Isabella Ward
Python Is So Slow. Can Julia Solve the Two-Language Problem?
By some benchmarks, Julia code can run 10X to 1,000X faster than Python—but there’s a reason it’s not a very popular programming language.
Sheon Han
Everyone Is Freaking Out About OpenAI and Anthropic’s Race for Dominance
Researchers fear AI is moving too fast, while Mark Zuckerberg is worried about who owns it. Plus: Inside Black Forest Labs’ push into robotics.
Maxwell Zeff
Chinese AI Researchers Are Finding Their Voice on X
As OpenAI and Anthropic employees grow quieter online, researchers at Chinese AI labs are flocking to X to explain their work, recruit talent, and shape the global conversation on AI.
Zeyi Yang
Here’s Why Anthropic Is Pushing States to Regulate AI Faster
The company endorsed landmark AI transparency laws in California and New York last year, but its head of US state and local policy says they may already be outdated.
Maxwell Zeff
China’s Open AI Models Are Challenging Silicon Valley’s Playbook
As access to Anthropic’s and OpenAI’s frontier models becomes more restricted, Chinese labs are pitching their open-source alternatives as stable, accessible, and increasingly capable.
Zeyi Yang
Google’s Gemini Can Now Stomp Around as a Humanoid Robot
The latest version of Google DeepMind's AI model includes a significant jump into “physical AGI.” But plopping AI into the real world comes with risks.
Will Knight
Nvidia Wants to Own Every Chip Inside AI Data Centers
Nvidia’s Vera Rubin platform combines CPUs and GPUs into a single system, reflecting the company’s growing ambition to power every layer of AI infrastructure.
Lauren Goode
Read Original at WIRED →