Episode summary

Making A ‘Plan B’ for the AI Boom

Wall Street Week · · 10 min · Guests: Sam Palmisano

Making A ‘Plan B’ for the AI Boom – Wall Street Week

Summary

The discussion centers on how the AI buildout is less a software sprint than a long-cycle capital program tied to data centers, semiconductors, and energy. Sam Palmisano argues that the frontier models may change quickly, but the physical infrastructure behind them has lead times of 3 to 5 years for data centers, about 7 years for semiconductors, and at least 10 years for nuclear power.

He says big hyperscalers are likely to control the near-term market because they can make the biggest bets first and secure scarce capacity. But he warns that the current flood of AI announcements may be more fragile than it appears, since many of the deals sound like memorandums of understanding and could be revised if adoption slows or the economics shift.

Palmisano frames the moment as a classic technology-cycle buildout that eventually resets costs, but he says investors and executives need a plan B. He also flags a competitive threat from China, where cheaper open-source models such as DeepSeek could pressure the return expectations on U.S. proprietary AI spending and take share across the rest of the world.

Key takeaways

  • Palmisano says the AI software stack is changing fast, but the infrastructure side is slow, with data centers taking 3 to 5 years and semiconductors about 7 years to come online.
  • He expects hyperscalers to dominate the market in the near term because they can make the largest capacity bets and secure data centers and energy first.
  • Palmisano says many AI funding announcements may be memorandums of understanding, so a slowdown in adoption could force spending plans to change.
  • He argues companies need a plan B because technology cycles often correct before the optimistic case plays out.
  • Palmisano says Chinese open-source models could lower costs and pressure U.S. returns, especially if China targets the rest of the world at scale.

Notable quotes

“-The software's changing fast and the models, right? The learning models, the frontier models, that's what's changing really fast”

— Sam Palmisano at 2:37

“Data centers aren't changing fast. I mean, the estimates are 3 to 5 years before this stuff comes online”

— Sam Palmisano at 2:44

“if this thing adjusts, say, economically... Suppose, for example, just adoption slows”

— Sam Palmisano at 4:07

“you have to have a downside case to go, we called it a plan B, quite honestly”

— Sam Palmisano at 9:14

“there's an alternative today. It's called open source”

— Sam Palmisano at 11:14

How the episode opens

We start with the hundreds of billions of dollars being raised to invest in artificial intelligence, including $500 billion in one deal done by NVIDIA. Sam Palmisano served as CEO of IBM, where he was responsible for capital investment in new technologies and the need to make sure they made money for the company. So Sam, there is a lot of money being invested in AI, whether it's chips or whether it's data centers, including the Nvidia announced deal of $500 billion.

Give us the perspective of a CEO of a big tech company. How do you decide how much to invest in a new technology? -How we would have thought about it, as you know, I have one of these big tech companies.

We would have thought about, where do we see the future state? And you go back to Watson with the 360, because that was going to be from unit record to computation color computer, right? In my particular case was AI, Watson, Jeopardy, you know, right?

So how do you jump ahead of the next generation? Because the investment cycles in the R&D are going to be several, several years. So you have to start no different than Quantum.

That's another example of that. That's true for all tech companies. I'd say it's true for many companies that are reliant upon any form of technology.

It could be energy and those sorts of things as well. So we would always look out in time. And that could be from the R&D cycle, it could be like a 7 to 10 years in the models, 3 to 5 for short term.

We'd call that operational investment, but for the longer term things. And then basically you start out with goals and milestones and objectives, because you don't have numbers.

From the episode’s captions: roughly the first two minutes, lightly cleaned. Keep watching on YouTube →

Topics

  • ai boom
  • data center spending
  • semiconductor chips
  • energy demand
  • china open-source models

Watch the episode

Watch “Making A ‘Plan B’ for the AI Boom” on YouTube

Summary, takeaways and quote selection by Octagon. Quotes are short excerpts; the full conversation is in the episode.

More from Wall Street Week

All Wall Street Week episodes →

Wall Street Week, this episode and its artwork belong to Bloomberg. Octagon is not affiliated with the show; this page is an independent summary.