Episode summary
Making A ‘Plan B’ for the AI Boom
Summary
The discussion centers on how the AI buildout is less a software sprint than a long-cycle capital program tied to data centers, semiconductors, and energy. Sam Palmisano argues that the frontier models may change quickly, but the physical infrastructure behind them has lead times of 3 to 5 years for data centers, about 7 years for semiconductors, and at least 10 years for nuclear power.
He says big hyperscalers are likely to control the near-term market because they can make the biggest bets first and secure scarce capacity. But he warns that the current flood of AI announcements may be more fragile than it appears, since many of the deals sound like memorandums of understanding and could be revised if adoption slows or the economics shift.
Palmisano frames the moment as a classic technology-cycle buildout that eventually resets costs, but he says investors and executives need a plan B. He also flags a competitive threat from China, where cheaper open-source models such as DeepSeek could pressure the return expectations on U.S. proprietary AI spending and take share across the rest of the world.
Key takeaways
- Palmisano says the AI software stack is changing fast, but the infrastructure side is slow, with data centers taking 3 to 5 years and semiconductors about 7 years to come online.
- He expects hyperscalers to dominate the market in the near term because they can make the largest capacity bets and secure data centers and energy first.
- Palmisano says many AI funding announcements may be memorandums of understanding, so a slowdown in adoption could force spending plans to change.
- He argues companies need a plan B because technology cycles often correct before the optimistic case plays out.
- Palmisano says Chinese open-source models could lower costs and pressure U.S. returns, especially if China targets the rest of the world at scale.
Notable quotes
“-The software's changing fast and the models, right? The learning models, the frontier models, that's what's changing really fast”
“Data centers aren't changing fast. I mean, the estimates are 3 to 5 years before this stuff comes online”
“if this thing adjusts, say, economically... Suppose, for example, just adoption slows”
“you have to have a downside case to go, we called it a plan B, quite honestly”
“there's an alternative today. It's called open source”
How the episode opens
We start with the hundreds of billions of dollars being raised to invest in artificial intelligence, including $500 billion in one deal done by NVIDIA. Sam Palmisano served as CEO of IBM, where he was responsible for capital investment in new technologies and the need to make sure they made money for the company. So Sam, there is a lot of money being invested in AI, whether it's chips or whether it's data centers, including the Nvidia announced deal of $500 billion.
Give us the perspective of a CEO of a big tech company. How do you decide how much to invest in a new technology? -How we would have thought about it, as you know, I have one of these big tech companies.
We would have thought about, where do we see the future state? And you go back to Watson with the 360, because that was going to be from unit record to computation color computer, right? In my particular case was AI, Watson, Jeopardy, you know, right?
So how do you jump ahead of the next generation? Because the investment cycles in the R&D are going to be several, several years. So you have to start no different than Quantum.
That's another example of that. That's true for all tech companies. I'd say it's true for many companies that are reliant upon any form of technology.
It could be energy and those sorts of things as well. So we would always look out in time. And that could be from the R&D cycle, it could be like a 7 to 10 years in the models, 3 to 5 for short term.
We'd call that operational investment, but for the longer term things. And then basically you start out with goals and milestones and objectives, because you don't have numbers.
From the episode’s captions: roughly the first two minutes, lightly cleaned. Keep watching on YouTube →
Topics
- ai boom
- data center spending
- semiconductor chips
- energy demand
- china open-source models
Watch the episode
Watch “Making A ‘Plan B’ for the AI Boom” on YouTube
Summary, takeaways and quote selection by Octagon. Quotes are short excerpts; the full conversation is in the episode.
More from Wall Street Week
-
What American Manufacturers Are Telling the Fed about the Economy -
Europe’s Welfare State Faces a Reckoning -
How the Blue Wave Could Reshape America’s Economy -
Inside Alaska’s Oil Paradox -
Wall Street Week | Blue Wave Economic Impacts, European Welfare Woes -
The $40 Trillion Problem Washington Won’t Talk About
Wall Street Week, this episode and its artwork belong to Bloomberg. Octagon is not affiliated with the show; this page is an independent summary.