Episode summary
Google: The AI Company. Google is amazingly well-positioned... will they win in AI? (audio)
Summary
Google’s AI story starts long before ChatGPT, with Larry Page treating search as an artificial intelligence problem and early Google engineers building language models that powered features like spell correction, AdSense, and Translate. The episode argues that Google was not late to AI because it lacked talent or infrastructure; it was late because it already had a hugely profitable Search business and had to balance disruption against margin preservation. By the mid-2000s, Google had accumulated a rare concentration of AI talent and a culture that let researchers push ideas into production quickly.
The episode traces how that advantage turned into Google Brain. Sebastian Thrun brought academic researchers into Google, Jeff Hinton’s deep-learning ideas gained traction, and Jeff Dean’s infrastructure work made large-scale training practical. The “cat paper” showed that unlabeled data plus massive compute could produce useful representations, helping unlock YouTube recommendations and other core systems. That technical shift also helped establish the modern AI stack, including the central role of GPUs.
The episode then frames Google’s later challenge: it helped create the AI revolution, but the value from those breakthroughs spilled into products and companies outside Google as well. That sets up the central question for the rest of the series: can Google keep leading in AI without sacrificing the economics of Search?
Key takeaways
- The hosts argue that Google effectively invented much of modern AI, but its Search monopoly made it structurally cautious about deploying disruptive products.
- Early Google language models powered real business wins, including spell correction, AdSense, and Google Translate.
- Jeff Dean’s distributed systems work and the CAT paper proved that large neural nets could run at Google scale and learn useful features from unlabeled data.
- The episode says the 2012 AlexNet breakthrough showed that GPUs, not CPUs, would become the critical hardware for deep learning.
- Google Brain’s gains reportedly more than paid for the rest of Google X by improving core revenue products like Search, ads, and YouTube.
Notable quotes
“If we had the ultimate search engine, it would understand everything on the web”
“the cat paper”
“We got that working and training on 2,000 computers using 16,000 cores”
“the first project within Google X Sebastian leads himself David don't say it don't say it”
How the episode opens
I went and looked at a studio. Well, a little office that I was going to turn into a studio nearby, but it was not good at all. It had drop ceilings, so I could hear the guy in the office next to me.
You would be able to hear him talking on episodes. Third co-host. Third co-host.
Is it Howard? No, it was like a lawyer. It seemed to be like talking through some horrible problem that I didn't want to listen to, but I could hear every word.
Does he want millions of people listening to this conversation? Right. All right.
All right. Let's do a podcast. Let's do a podcast.
Who got the truth? Now, is it you? Is it you?
Is it you? Sit me down. Say it straight.
Another story on the way. Got the truth. Welcome to the fall 2025 season of Acquired, the podcast about great companies and the stories and playbooks behind them.
I'm Ben Gilbert. I'm David Rosenthal. and we are your hosts.
Here's a dilemma. Imagine you have a profitable business. You make giant margins on every single unit you sell and the market you compete in is also giant.
One of the largest in the world, you might say. But then on top of that, lucky for you, you also are a monopoly in that giant market with 90% share and a lot of lock in. And when you say monopoly, monopoly as defined by the US government.
That is correct. But then imagine this. In your research lab, your brilliant scientists come up with an invention.
This particular invention when combined with a whole bunch of your old inventions by all your other brilliant scientists turns out to create the product that is much better for most purposes than your current product.
From the episode’s captions: roughly the first two minutes, lightly cleaned. Keep watching on YouTube →
Topics
- google ai strategy
- transformer impact
- openai chatgpt competition
- gemini deepmind merger
- waymo robotaxis
Companies and tickers mentioned
- GOOGL
- GOOG
- LYFT
- MSFT
- OpenAI
- Anthropic
- Waymo
- Lyft
- Microsoft
Watch the episode
Summary, takeaways and quote selection by Octagon. Quotes are short excerpts; the full conversation is in the episode.
More from Acquired
-
Seinfeld - Full Episode (Audio) -
Home Depot: The best-performing stock in the S&P 500 since IPO (Audio) -
Disney: The Renaissance and the Empire -
The Walt Disney Company: The most successful enterprise for monetizing human nostalgia (Audio) -
Vanguard: The communist capitalist who saved investors a trillion dollars (Audio) -
Ferrari: What happens when you staple a luxury brand to a sports team? (Audio)
Acquired, this episode and its artwork belong to Ben Gilbert and David Rosenthal. Octagon is not affiliated with the show; this page is an independent summary.