
Jensen Huang sees a path to $1 trillion in AI infrastructure. Is Wall Street buying it?
Loading summary
Mary Long
There's a new chip on the block. You're listening to Motley Fool Money. I'm Mary Long joined on this fine.
Asit Sharma
Wednesday Morning with a Mr. Assit Sharma.
Mary Long
Assit. Thanks for being here, Mary.
Ricky Seiple
Thank you for having me.
Mary Long
Of course.
Asit Sharma
Of course. We've got some big news happening after we record, but before the show publishes this morning. That is of course that a Mr. Jerome Powell will be making some announcements later today. We're not going to hit that on today's show. Ricky and Nick Seiple will cover that tomorrow. Instead, Asit, you and I have another big name dropping, another announcement or multiple announcements. That big name is Jensen Huang. Nvidia had its GTC GPU Technology conference. It's running throughout this week and yesterday Mr. Huang delivered the keynote speech. Asit, this is an event that used to be kind of predominantly catered towards academics and now it's turned into what the New York Times dubs the super bowl of AI. We got a number of things coming out of that keynote that you and I will hit on on today's show.
Mary Long
But we'll start with this.
Asit Sharma
In late 2026, Nvidia will release its next generation of GPUs. They're calling this generation the Vera Rubin. So what do investors need to know about this upcoming generation of chips and how it's different from perhaps should we call it its predecessor, the Grace?
Ricky Seiple
Mary I'm going to call it Vera Rubin just for some fun shift in pronunciation. It's probably Vera, but anyway. So what is Vera Rubin? Vera Rubin is an improvement on the Blackwell architecture. So that's Nvidia's current, biggest and baddest GPU complex accelerator technology. And Vera Rubin is does improve on Grace. You're referring to the cpu, the chip that goes in the Blackwell. Blackwell has a GPU unit and a CPU unit. So Vera Rubin replaces that chip unit Grace with something called new Grace, which is supposed to have two times the performance. And overall this GPU system has a lot of compute power that improves on Blackwell. For example, it's got what is called NVLink scaling. This is when GPUs in a system communicate with each other, send information back and forth. That doubles the power of over Blackwell, the ability to scale between GPUs, NVLink scaling. It has something called HBM4 memory. You probably heard us, if you've been listening to Mary and I or myself and Ricky over the last year or two, talk about something called HBM3, which is a type of memory within GPU structures. So this is the latest version of that, and it just has much more compute power, almost 10 times the aggregate compute power of the Blackwell platform. So in many ways, Vera Rubin just represents a really big leap. And then it's going to be followed up, Mary, by something called the Vera Rubin Ultra, which is a little bit funny. Okay, I'm digging here a little bit at something that shouldn't be criticized too much. I mean, it's going to be an advancement over an advancement, the next next generation, the company's platform. But come on, this reminds me of new and improved from the grocery store when we were growing up, Mary, like after a while, how do you communicate that something's even better? Not Vera Rubin plus, but Vera Rubin Ultra sounds about right. And I want to lay a criticism here on Nvidia, which is a company I admire. The CPU of this Vera Rubin system, which we called New Grace. They called New Grace, is complemented by the new GPU graphics processing unit in the system, and that's called the CX9. Again, Nvidia may be running out of inspiration here. When you start naming your GPUs after Mazda SUVs.
Asit Sharma
Asit, you and I have a tendency to really harp on what's in a name and why a company decides to name a certain project xy. And so we were talking a bit before the show about. It's interesting to see Nvidia in particular. We'll pick on them right now to see Nvidia in particular give these names to all these different products, but they can be very hard. I appreciate why they're taking the time to name something, name a GPU Vera Rubin, rather than hbm or a series of numbers and letters. I do appreciate that. But it still can be very hard for the layman to differentiate between all these different names, between cuda, which is more of a software platform, and the Grace, the Rubin and Blackwell, and how these pieces fit together. So thank you for kind of giving us the lay of the land a little bit and giving us a insight into what all these new announcements actually mean. When it comes to what all these new announcements actually mean, some news that came out last week was that Meta is planning to train its own AI chips. Amazon and Google are already in the process of doing this. And this is all these companies, these hyperscalers, are training their own AI chips in the hopes that they can ultimately reduce their reliance on Nvidia. So help us understand what Nvidia's head start looks like, because they are kind of the go. Not kind of, they are the go. To player in this game right now, realistically, what do Meta, Amazon, Google, anyone else that's interested in training their own AI chips? What do they actually have to do to build in house chips that genuinely rival what Nvidia is putting out there?
Ricky Seiple
Mary One thing they have to do is to make simpler chips that have custom purposes. So when you train a model or when you get inference out of that model, not all of it has to be done on the latest and greatest GPUs. And so to the extent that a company like Amazon with its Trainium chip, it's now in the three series, approaching the three series, a company like Meta, which is getting into the game, or even Microsoft, which is later to the game, with a chip called Maya, what they're trying to do is to cut costs dramatically. So when you or I use a large language model on their cloud platforms, it costs less for us, the end user, we're paying some way. And enterprise businesses are paying direct to these companies. So they have a lot to gain because they really don't need the overkill of awesome Nvidia GPUs for many of these use cases. And that's why they're investing in this. They're working with great design companies, they are taking models, sending them over to tsmc, a great foundry, getting back prototypes, and then gradually, I think Amazon is furthest along this race, just putting them into the data centers and showing a cost savings. On Amazon's last conference call, CEO Andrew Jassy said, Look, we're reducing compute cost by 30% in some cases. Now Nvidia is looking at this and saying, ha, ha ha. Why? Why is Nvidia smugly smirking and laughing? Because we want ever more powerful compute and the world is moving in the direction of reasoning models, where we're asking the models to think in steps to go out and research on the web, come back to us with answers. And really the chips that are best designed for that are the GPU CPU complexes that Nvidia builds. So it believes it still has a really, really major role to play in this world going forward. I think maybe the true story is somewhere in the middle and time is going to tell how it really shakes out.
Asit Sharma
Patrick Moorhead, who's the founder of Tech Research Forum Moor Insights and Strategy, told the New York Times for an article kind of about, again this conference, the Super bowl of A.I. that quote, the gravy train comes to a screeching halt if cloud companies stop spending. End quote. So that's the gravy train that Nvidia is currently reaping the benefits of what can Nvidia do today to freeze some of that gravy for the future if there is a potential hibernation winter period ahead?
Ricky Seiple
Well, one thing they can do is to focus on the replenishment cycles. So even though data centers may get crimped at the margins, the data center buildouts, you have all these existing data centers that need to be upgraded in terms of their capacity, server capacity, memory capacity, et cetera, to meet the demands of our compute. Just because AI might become less expensive doesn't mean we're going to stop using it. So Nvidia can really think forward in terms of where they can start going to these customers and working on upgrades to existing data centers if they pull that new build out. And I don't think that'll necessarily happen as sort of this cliff moment, which some project. If you look back before what happened with Generative AI, we had a really slow, steady, but almost inexorable march to build data centers just to handle the migration of enterprises taking their stuff off of premise into cloud. And those percentages, if you look at them, they still have a long way to go. Even that people have sort of forgotten this movement is still in motion. So over time, I think what we're going to see is, yeah, there could be some valleys, some unexpected slowdowns in data center builds, but the direction of the future, until we can make these things much more efficient, both from a consumption standpoint and an energy standpoint, is to keep building. And Nvidia stands to gain from that.
Asit Sharma
Oh, and the direction of the future that Jensen Huang sees is a trillion dollars in AI infrastructure build out. That was a number that really stuck out to me. He mentioned that the company's already built out about 100 billion of AI infrastructure, but again, that he sees a roadmap to a trillion dollars sooner rather than later. What did you make of that number, that statement, that vague timeline?
Ricky Seiple
Not much. It's not too different from a number that he dropped like three years ago. It's just that no one could see that future. He was talking about hundreds of billions within a few year periods three years ago. And it just seemed like, well, I guess if you're talking about extremes and everything falls into place and everyone would have to be using this stuff, right? Everyone would have to be using ChatGPT for that to happen, I guess. So Jensen, if we go back and extrapolate his original projections, guess what? Right on the mark. A trillion bucks.
Asit Sharma
So that's interesting context too. Because we've seen Nvidia stock go down about 15% thus far this year. It was down over 3% yesterday alone. In spite of all these, these big advancements that, that Jensen Huang is, is touting, Nvidia's PEG ratio today is just under 0.3. So despite all of the advancements that they're rolling out that they're talking about and hyping up, the market seems to think that this company's growth is going to stall out. Did you hear or see anything during yesterday's keynote? Kind of throughout the, the, the span of this conference that made you think, oh, maybe the market's got it right? Or do you think this is another situation where we're kind of where we were three years ago, where Jensen Huang is saying this is the future and folks just aren't buying it because they can't see it?
Ricky Seiple
I think we should bring a lot of skepticism to bear to Nvidia's growth thesis just because now everyone wants to disrupt them on every level. And companies that didn't have to compete with Nvidia yesterday, let's look at Arista Networks in the networking space, suddenly find it as a competitor and they have to shift their models. Arista Networks is an amazing company, by the way, so it's not like they're going to completely reinvent their business, but now they're paying attention to what could be some competition for them. So I think when you think about this, you think about companies that are trying to figure out ways to make compute more efficient. You have small competitors that are questioning even the way we build GPUs. I think we really have to be skeptical on the growth thesis. But I mean, you bring up something interesting, Mary. What you're basically saying is, hey, that PEG ratio, what if that means that it really is undervalued in relation to its potential to earn out in the future? And yeah, I saw lots of stuff in that presentation that told me this could happen. Just take one thing. So you mentioned cuda, which is a collection of software acceleration libraries. We've talked about this before. Marian and I pointed out that, look, CUDA is lots of different libraries. There's one for high precision math, there's one for aeronautics, there's almost one for every really cool use case you can think of across so many industries. And yet we see another one that was introduced yesterday, which is a version of something those who know the language Python, programming language Python, are very familiar with. There's a library called Pandas, and it has to do with Something called data frames. It's essentially how we manipulate data. What Nvidia is doing now is taking the concepts behind data frames and extrapolating that into massively parallel computing use cases. Which just points to a future in which the assumptions we had about how we use big data and how fast we can wreak stuff out of it, maybe those assumptions are off because if we take the same concepts from Python, but throw those into these great acceleration libraries which are running on GPU sets that are much more powerful than what is on the ground today, then it means that lots of fun things that we do with computation today we can do in a much shorter time. And there will be potentially some very interesting advancements in science, in big data, et cetera. That's just one little thing I saw that indicated to me that they keep innovating and creating a use future use for their technology. So I wouldn't bet against the company. I think right now it's sort of like be skeptical, be very skeptical, but don't discount the possibility that three to five years from today you and I could be talking about some ho hum, amazing double digit growth rate that Nvidia holds.
Asit Sharma
One of the central themes of yesterday's keynote was that AI has use cases in every industry and that it's Nvidia that's really laying that foundation across all those industries. So as a part of that thesis we have this many announcements about partnerships between Nvidia and different companies. So I'm going to call out three different partnerships that stuck out to me and then we can kind of. You let me know which one's most interesting to you and we can kind of go from there and give a few more details on it. So we've got GM and Nvidia teaming up to build out GM's fleet of fully self driving vehicles. We've got Walt Disney, Google's DeepMind and Nvidia building a platform that will quote Supercharge humanoid robot development.
Mary Long
We've also got Nvidia partnering with Yum.
Asit Sharma
Brands, that's the parent company of Taco Bell, KFC and Pizza Hut. And they're going to roll out AI order taking. Which one of these do you want to take? Asit.
Ricky Seiple
Let's do a lightning round, all three because they're all fun. Let's start with the drive through.
Asit Sharma
Okay, so we'll start with the drive through. First of all, my question here is do you want AI ordering? I've seen a ton of fast food companies roll this type of stuff out. McDonald's, roll this out and then also roll it back. McDonald's this past summer ended their partnership with IBM when it came to AI ordering. I think that this idea of efficiency at all costs at the drive thru, it does, I understand why companies are pursuing that. But it also runs counter to a story that we've seen play out at Starbucks where hey, you lean too hard into efficiency and that actually pushes some consumers away. So what do you think the future of this, this Yum Brands Nvidia partnership could look like?
Ricky Seiple
The AI is getting better and better. At the end of the day, what I want is really the human interaction. But you know what I'll take, Mary, is an AI that's smart enough to get something wrong in the order so I have to correct them and just fool me. And you wanted large fries with that? No, ma'am, I said medium fries. Right. That's the AI interjecting something to make me think it's human. So I'll take it in that instance.
Asit Sharma
So then we've also got this self driving feature. What's interesting to me is that GM has struggled in its attempt to build out fully autonomous vehicles. Last year they pulled funding for its cruise robo taxi company. Were you at all surprised to see GM seemingly giving full self driving another go?
Ricky Seiple
I guess I was, but obviously I wasn't paying enough attention because GM sort of signaled this. We talked about it, Mary, like we're not going to focus on trying to have a full fleet of autonomous vehicles. We're going to focus on the software side, getting that into our vehicles, working with simulations so that our software is second to none, the software that's in the vehicle for your driving experience. So it's assisted driver technology. That's interesting.
Asit Sharma
Okay, last but not least, we've got this robot situation. I mentioned a partnership of three between Walt Disney, Google's DeepMind and Nvidia. I get Google, I get Nvidia. Walk me through how Walt Disney fits into that trio.
Ricky Seiple
Walt Disney actually has a long history with robotics. Think the animatronics at their theme parks, they're very good at robotic motion and making it sort of human like. They also have research labs out near Burbank, near their studios, which have been working for a long time on robotics and the science, the physics of how these robots work and the expression of that. And then you think of their animation and motion expertise that divisions like Pixar bring. And you actually have a company that makes sense when you put that puzzle together with Those gurus from DeepMind and Nvidia's just very strong research into the robotics field and its forte in simulation and virtualization. I actually was surprised, but thought to myself, that makes sense.
Asit Sharma
We got Quantum Day coming up tomorrow. I know you said that you're really excited for that.
Mary Long
Anything in particular that you'll be keeping.
Asit Sharma
An eye or ear out for?
Ricky Seiple
Nvidia already said that it's working on some CUDA libraries for quantum and there are some really interesting problems that quantum computing needs to solve before it becomes big time. One of those is correcting for errors in the computation. So without getting to any weeds, because we haven't got time, I'd be very interested to hear about how their software might help on the quantum level, cut down the error rates when we ask these particles to do their thing and measure them and try to get a mathematical result out of that. So that's what I'll be looking for tomorrow.
Asit Sharma
Asit Sharma, always a pleasure. Thanks so much for talking in video with me today and for breaking down.
Mary Long
These these often complex topics.
Ricky Seiple
Lots of fun, Mary, thank you so much.
Mary Long
You got questions? We got answers. Up next, we continue with Mailbag week and turn to a number of Motley fool analysts to answer your questions about fundamental analysis, AI in healthcare, portfolio management, and how customer service experiences ought to affect your investment decisions.
Patrick Moorhead
Trading at Schwab is now powered by Ameritrade, giving you even more specialized support than ever before. Like access to the trade desk. Our team of passionate traders ready to tackle anything from the most complex trading questions to a simple strategy. Gut check. Need assistance? No problem. Get 24. 7 professional answers and live help and access support by phone, email and in platform chat. That's how Schwab is here for you to help you trade brilliantly. Learn more@schwab.com trading every now and then.
Mary Long
We'D like to turn to our listener mailbag to see what kind of questions are on your mind. We noticed that there were a lot of questions that were roughly about how to get started investing. So for today's show, we rounded up a few analysts to answer your questions that are geared towards the beginner or intermediate investor. To kick us off, we got listener Cody King, who wrote in Fools for new investors. What are some fundamentals to look at when considering investing in a stock? Is it P E ratio? Most recent quarter's earnings news headlines? Are any metrics overrated? What is the key info to dive into to determine if a stock is a winning investment? For the answer, we turned to none other than fool analyst Asit Sharma.
Ricky Seiple
Cody, I love your question for Me, there are two things that go on when I'm thinking about stocks or selecting stocks. One is to sort of screen for new ideas or turnover stones, if you will. And in that sense, different metrics like the P E ratio can be very useful in just comparing companies and seeing what might be a really high pe. Sometimes that's a signal for a good stock because you're looking at a company that must be growing its revenues or has the potential to do so. But let's take a step back because your question really asks what is the key info to dive into to determine if a stock is a winning investment? And that's quite a different thing. For me, the most important thing is the story, the narrative behind that company. If you can grasp that, then you can put an overlay of everything else. You can crunch the financials, you can look at ratios, you can compare it to other companies. And one of the places that I like to start is the M D and a section of a quarterly or annual report. You can go to Edgar, this is sec.gov and search these reports. They come labeled in varieties of 10k for annual and 10q for quarter. When you go to this section, what you're looking at is a required explanation of what a company does and how its recent past has fallen out. It's a required disclosure from the sec. It's part of regular reporting. And that's a great place to understand exactly what management thinks about its company, how it presents its products or services, where it sees the business going, and it discusses. That section, discusses recent results. I like to start from there. And if I can grasp that and really feel that I'm starting to understand what a company does and what its potential might be, then the other things that you mentioned, like listening to earnings transcripts, looking at the most recent quarter's earnings, thinking about the news headlines, those are really key at that point to getting a beat on whether this is a company you want to put into your portfolio or. Or take a pass on.
Mary Long
We talk about a lot of stocks on the show. Some of them are genuine investment ideas. Others are just public companies that we find interesting or newsworthy but don't necessarily think of as strong. Stock picks. One listener, Sumit Maroo, asked about how listeners ought to think about what we call radar stocks. They write. I listen to the show religiously every day. One of the questions I have is about the radar stocks. Every Friday, the team picks two radar stocks. I love what Jamo, Mattie and Emily bring to the section, but I'm not sure what Everyday investors like me should do with those picks. For the answer, we turn to the host of our Friday show, Dylan Lewis.
Dylan Lewis
I'm glad someone asked because I love the radar stock segment and I think sometimes it does go on without explanation. MARY for me, I think the radar stock segment puts us in a position to talk a little bit about stuff that is going on in the market that our analysts really want to discuss or feel like will be popping up in the news at some point in the next week or two. Very often you'll have our analysts previewing a company that's report earnings. Sometimes they'll be talking about a company that they're not particularly excited about, but they feel like it's something that they should bring up for listeners of the show if it's a company that's in their portfolio. And so I joke sometimes that people bring radar stocks on for good reasons because they're excited and they're following this business. Maybe it's a future watch list stock for them. Sometimes it's a radar stock for a bad reason and it's more of a moment for us to give people a check and make sure they're paying attention to some of the things that could affect companies in their portfolio.
Mary Long
Speaking of investment ideas you get from the news, it's no secret that excitement about artificial intelligence is everywhere. Dana in Cincinnati wonders how healthcare companies in particular are using AI and whether she might find any intriguing. Stock picks herself from looking at the intersection of those interests in a multitude of ways.
Jason Moser
And that's, that's probably why it's something we can talk about at greater length. But just to pick an interesting area has to do with how you design drugs. And some people may know that the Nobel Prize in chemistry in 2024 went to the developers of Alphafold, which is a program that can predict protein structure just from the amino acid sequence. That's actually not a brand new thing. But using some AI tools, they were able to make it better than it's been in the past. And the upshot of that is that you can actually visualize in three dimensions what target you're designing a drug against with with a lot more ease than you could do in the past. Once you get to that point, you can start to use digital tools to help make molecules that sort of fit like a hand in glove into those targets that you're looking for. So these are all approaches that have been used for years. It's often called rational drug design. It's something that most companies do to some extent, but you're seeing it step up in its complexity. And so it remains to be seen how much this bends the curve when it comes to speeding anything up or making anything better than we have in the past. But you're seeing some interesting programs sort of advance into clinical trials. And particularly interesting are companies that are going after targets that were once considered, quote, unquote undruggable. So a target where the pocket you're trying to bind into is very hard to fit without making basically a key that opens everything. If you make a key that opens everything, that's called having a ton of toxicity, right? You need it to bind to just that target. And so if you can do that and show that some of these work, I think you're really going to see even more emphasis on this area.
Mary Long
You can learn a lot about companies not just through the news, but also through your own experience with them as a consumer. Yuan Liu wrote in with a question for fool analyst Jason Moser, which we'll paraphrase here. I know you like PayPal and want to ask why is its customer service aggressively mediocre? It used to be that you could just pick up the phone and talk to someone or leave a private message on a message board and someone would get back to you. In the past few years, however, all I can do is initiate a chat with absolutely no ticket id, no queue name, nothing to allow the next agent who happens to be on the thread to understand what my question was or what information has already been exchanged. How much weight do I put on this experience when it comes to making a decision about buying or selling any kind of stock?
Yuan Liu
So I think that's a good question. And one of the reasons is because there's not one definitive answer. This is something that each investor kind of has to answer for themselves. And so, for example, like I'll say, one of the reasons why I like PayPal is just because it always works. I honestly don't think I've ever had to actually contact PayPal customer service. So I think based on the question, I'm considering myself lucky at this point because that stinks when you get bad customer service. And so I suspect if I had to interact with, you know, a company and continually got bad customer service, that would absolutely make me question whether or not this was a business that I really ultimately wanted to own. Now you see these stories play out all over the market. I think Comcast stands out as an example, as a company that really owns their space in a lot of ways and certainly is one of, one of just a handful of very big players in what it does. And I think perpetually they've had a reputation for just awful customer service. Now, again, not a Comcast subscriber. We don't have it here, so I don't use it. I don't have that experience. But based on everything I've heard, that starts to make you wonder, well, is this a company? I feel really, you know, do I feel good about owning this? And so I think for every investor, they have to be able to weigh that a little bit in saying, well, is this a place where a company can improve versus are there a lot of positive qualities that this company already has? Right. None of these investments is perfect. And I think that's something always to remember is that none of these investments is perfect. We try to identify the areas of weakness where they can improve, try to identify the areas of strength, and then you kind of have to weigh those against each other. And I guess for me with PayPal, I mean, I still own shares in the company and I've owned them for many, many years. It just strikes me as one of the companies that's really leading the way in this digital movement of money. Are there things that they could be doing better aside from customer? Absolutely. And I'm hopeful that new leadership here in Alex Kris is really spearheading that. He seems like he has some really neat strategies and I think the market is starting to take note of that. But ultimately, yes, this is a question that each, each investor has to answer for themselves. I think looking at that customer experience, that's something that you definitely need to weigh. That's a valid concern that every investor should, should take into consideration.
Mary Long
Once you've found the stocks you want to buy, you'll have to figure out how big a role you want each of those positions to play in your portfolio. Over on X, Georso asked us for a beginner middle experience investor. Are you better off buying small shares of multiple companies or saving up and buying a larger share amount in fewer companies? For the answer, we look to OSIT again, georso.
Ricky Seiple
I think for beginner, middle, and even advanced or very experienced investors, we're all better off buying small shares of multiple companies at the start of the game. Now, yes, I'm being partly facetious here because if you are an extremely experienced investor, you may have this actually already in practice, but in a different way because you're building up a lot of conviction and then putting your money in and putting serious capital to work. But the principle is that we are taking small stakes at the beginning to learn about businesses as they grow. And we're going to keep adding money to the businesses we come to understand better and that keep performing as time goes on. That's a really great way to make money and it's actually probably a better probabilistic strategy versus identifying at the outset a few companies where we're going to allocate a lot of capital to. That implies that you've got a really good edge on the house in this game. And Ricky Mulvey and I had a great conversation likening investing a bit to probability and playing cards. For most investors, the opposite is the strategy to use, which is you're going to find out over time where you're going to concentrate your capital. Don't do it at the beginning, and I will say over time. Even though Warren Buffett is associated with taking big and concentrated bets, we've seen him in some businesses scale up over time. Of course, you know his billions have a lot more impact than maybe our hundreds or thousands. Nonetheless, this is a really fun strategy to employ because it allows you also to learn about a lot of companies and to extend your investing chop. So so I'm all for going with more companies, smaller positions, taking your time, and then concentrating further investments on those winners and also adding new ideas to your portfolio as the world changes.
Mary Long
We love giving listener questions, so if you've got a question that you'd like to hear an answer to, write to us on X or shoot us an email@podcastool.com that's podcasts with an swool.com we'll be sharing a few more of these with you on tomorrow's show. See you then, fools. As always, people on the program may have interest in the stocks they talk about, and the Motley fool may have formal recommendations for or against. So don't buy or sell stocks based solely on what you hear. For the Motley fool team, I'm Mary Long. Thanks for listening, fools. We'll see you tomorrow.
Ricky Seiple
Sa.
Motley Fool Money - Episode Summary: "Nvidia’s New Chips, with a Side of Valuation" (March 19, 2025)
Hosted by Dylan Lewis, Ricky Mulvey, and Mary Long
In this episode of Motley Fool Money, hosted by Mary Long, Asit Sharma, and Ricky Seiple, the discussion centers around Nvidia’s latest advancements in GPU technology, the competitive landscape in AI chip manufacturing, and the company's current market valuation. The hosts delve deep into the implications of Nvidia's new chip releases, partnerships, and the broader AI infrastructure market.
Mary Long opens the discussion by highlighting Nvidia’s recent keynote at the GPU Technology Conference (GTC), describing it as the "Super Bowl of AI" (00:22). The focal point is Nvidia's announcement of its next-generation GPU, the Vera Rubin, set for release in late 2026.
Key Points:
Vera Rubin Enhancements: An improvement over the current Blackwell architecture, Vera Rubin introduces the new Grace CPU, which doubles the performance of its predecessor. The GPU system boasts enhanced NVLink scaling, allowing GPUs to communicate more efficiently, effectively doubling the scaling capabilities of Blackwell.
"Vera Rubin just represents a really big leap." — Ricky Seiple (01:29)
Memory and Compute Power: Featuring HBM4 memory, Vera Rubin offers nearly ten times the aggregate compute power compared to Blackwell, positioning it as a significant advancement in GPU technology.
Future Developments: Following Vera Rubin, Nvidia plans to release Vera Rubin Ultra, an iterative advancement aimed at further enhancing performance, albeit with a playful nod to naming conventions.
"Nvidia may be running out of inspiration here... When you start naming your GPUs after Mazda SUVs." — Ricky Seiple (03:50)
Asit Sharma raises concerns about major tech companies like Meta, Amazon, and Google developing their own AI chips to reduce dependence on Nvidia.
Key Points:
Custom AI Chips: These companies aim to create simpler, purpose-built chips that can efficiently handle specific tasks, thereby cutting costs and reducing reliance on Nvidia's high-performance GPUs.
"They have a lot to gain because they really don't need the overkill of awesome Nvidia GPUs for many of these use cases." — Ricky Seiple (05:45)
Prototyping and Deployment: Companies are collaborating with design firms and foundries like TSMC to develop prototypes, with Amazon reportedly leading in deploying cost-effective solutions in their data centers.
Nvidia's Response: Despite the competition, Nvidia remains optimistic about its role, particularly with the evolving demands of more complex AI models that require powerful GPU-CPU complexes.
The conversation shifts to Nvidia's stock performance and market valuation, highlighting a PEG ratio of just under 0.3 despite significant technological advancements.
Key Points:
Stock Performance: Nvidia's stock has declined by approximately 15% year-to-date, with a 3% drop observed the day before the podcast.
Valuation Concerns: The low PEG ratio suggests that the market may be skeptical about Nvidia's future growth potential, despite the company's aggressive innovation and expansion plans.
"We should bring a lot of skepticism to bear on Nvidia's growth thesis..." — Ricky Seiple (07:47)
Growth Prospects vs. Competition: While skepticism exists due to increasing competition, innovations like Nvidia's CUDA libraries and advancements in AI acceleration suggest potential for long-term growth.
"Just take one thing... could do in a much shorter time." — Ricky Seiple (11:32)
Asit Sharma highlights several strategic partnerships Nvidia has formed to expand its AI footprint across various industries.
Key Partnerships Discussed:
GM and Nvidia:
Objective: Building out GM's fleet of fully self-driving vehicles.
Insight: Despite GM's previous challenges with autonomous vehicles, the focus is now on integrating advanced software into existing vehicles to enhance driver assistance technologies.
"We're going to focus on the software side... assisted driver technology." — Ricky Seiple (16:48)
Walt Disney, Google’s DeepMind, and Nvidia:
Objective: Developing platforms to "supercharge humanoid robot development."
Insight: Combining Disney’s expertise in robotics and animation with DeepMind's AI prowess and Nvidia’s simulation capabilities to advance humanoid robotics.
"Walt Disney actually has a long history with robotics... it makes sort of human-like." — Ricky Seiple (17:29)
Yum Brands and Nvidia:
Objective: Implementing AI-driven order-taking systems in fast-food chains like Taco Bell, KFC, and Pizza Hut.
Insight: Exploring the balance between efficiency and customer interaction quality, with discussions on the potential pitfalls of over-reliance on AI in customer service.
"AI is getting better and better... I'll take it in that instance." — Ricky Seiple (16:32)
Asit Sharma briefly touches upon Nvidia's endeavors into quantum computing, particularly in preparation for Quantum Day.
Key Points:
Quantum Error Correction: Nvidia is developing CUDA libraries aimed at reducing error rates in quantum computations, a critical hurdle for the advancement of quantum technology.
"Nvidia already said that it's working on some CUDA libraries for quantum..." — Ricky Seiple (17:29)
Potential Impact: Enhancing quantum computing capabilities could open new avenues for AI and data processing, reinforcing Nvidia's position in the tech landscape.
The latter part of the episode features a mailbag segment, addressing various listener questions related to investing fundamentals, radar stocks, AI in healthcare, customer service experiences impacting investment decisions, and portfolio management strategies.
Notable Discussions:
Investing Fundamentals:
Question: What key metrics should new investors focus on?
Answer: Emphasis on understanding a company's narrative through sections like M&A in quarterly reports before delving into financial ratios.
"If you can grasp that, then you can put an overlay of everything else." — Ricky Seiple (20:56)
Radar Stocks:
Explanation: Radar stocks are companies analysts keep an eye on for potential future movements, either positively or negatively.
"Sometimes it's a radar stock for a bad reason..." — Dylan Lewis (23:35)
AI in Healthcare:
Insight: AI tools like Alphafold enhance drug design by predicting protein structures, aiding in the creation of more effective and less toxic drugs.
"You're seeing some interesting programs sort of advance into clinical trials." — Jason Moser (24:42)
Customer Service and Investment Decisions:
Discussion: Assessing a company's customer service quality can influence investment decisions, balancing it against other strengths.
"Is this a business that I really ultimately want to own?" — Jason Moser (27:14)
Portfolio Management:
Advice: Beginners and intermediate investors are encouraged to diversify by acquiring small shares in multiple companies initially, gradually concentrating investments based on performance and conviction.
"Buying small shares of multiple companies at the start of the game." — Ricky Seiple (29:44)
The episode concludes with reminders to listeners about the importance of conducting personal research before making investment decisions and an invitation to submit further questions for future shows.
"Don't buy or sell stocks based solely on what you hear." — Mary Long (31:33)
Notable Quotes:
This comprehensive discussion provides listeners with an in-depth understanding of Nvidia's technological advancements, the competitive dynamics in the AI chip market, and strategic insights into investment practices, making it invaluable for both novice and seasoned investors.