Like a global technology conference. I'm Vivek Arya, cover semiconductor, semi-cap equipment, and I'm really delighted and honored, and it's a real treat to have Colette Kress, Executive Vice President and CFO of NVIDIA, to join us for a keynote session this morning, fresh off a number of announcements from GTC Taipei. Perhaps, Colette, if you could start with maybe giving us some sense of what NVIDIA announced, how it fits your strategic direction, and then we can go into a few other questions. Thank you so much for joining us today.
Thank you for having me. I'm going to give you one quick statement at the very beginning here. As a reminder, this discussion may contain forward-looking statements, and investors are advised to read our reports filed with the SEC for information related to our risks and uncertainties facing our business. GTC Taipei was a really great event. We do enjoy going to Taiwan, meeting with such an important part of our suppliers, and helping our suppliers and that full ecosystem really understand the progress we're making and speaking to them directly on that. There were great announcements that we did make. One of the top announcements is, let's not forget, Vera Rubin is on its way and definitely is in full production. As we had discussed, part of our earnings, we indicated that, yes, it is planned for the second half.
More importantly, we talked about it's coming soon. It's ready for Q3. Q3, we're looking forward to standing up Vera Rubin. As you can imagine, we're already in full production in order to make that plan within Q3. That was one of the very first pieces of it. The other piece is some of the excitement that folks have talked about, which is referred to as Vera CPU. Vera CPU is a great opportunity for us to both continue to expand with an important area of agentic solutions. When you think about agentic solutions, that CPU is going to be an essential part, the director of directing that agentic work together. We have the ability, again, to do a extreme co-design with what we enabled with a CPU. That extreme co-design is different than many other types of CPUs that are out there.
It is on our own cores. It also has a tremendous improvement in terms of productivity, but also in terms of just its sheer performance is about a 2x versus any of the other X86 CPUs. We've added this to our portfolio, not only within our full systems that we have for Vera Rubin or even what we have with our existing Blackwell, but this is also an opportunity to sell standalone, and we do believe that will be a big opportunity for us. This is also a time to talk about what we can do in terms of the PC. We've been working very feverishly with many different providers to help us on that, but this is putting together RTX Spark into the market.
This is a great opportunity for AI types of PCs and very, very key in focusing those that will be doing agentic type of work as well and using that PC with the performance. It's built together with MediaTek as well as our GPU, and that's a great opportunity for us. Lastly, this was a discussion to talk about really the diversification of both what we are building, but also the different types of customers and users that we see worldwide. We're in a unique position versus any other type of company, and you'll hear more of that, I think, in our discussion when we talk about not only just the hyperscalers, but a very important group of AI clouds and what they have built in terms of the market. We have so many different folks that we need to help with. That will be the enterprises.
That will be the industries. That will be sovereigns. We have that complete diversification in everything that we're selling. Those were some of the key highlights that we had.
Excellent. Maybe let me pick up Colette on that point, because I think one of the very important disclosures you made as of the last earnings call was giving us this transparency between hyperscalers. I was struck by two things. One is that both businesses, both your sales to the large public hyperscalers and this other business to the neo cloud sovereign on premise, they're about the same size, but the hyperscale business is growing faster. I would have thought that the other business would be smaller and growing faster, but it's the same size and growing slower. If you could just walk us through what is the right way to interpret that disclosure?
Let's step back and talk about our disclosure we've had. We've been providing, of course, the data center numbers that we've had. One of our focus was to provide you an understanding of compute and networking. What was interesting is we're going on our now third generation of an extreme co-designed full data center scale system. We're taking that and breaking that down to show you compute networking. If you think about it, all of those full systems are always going to incorporate both our compute and networking together. Our attach rate of what we are seeing in terms of the networking is an enormous piece of that as well. We're probably more than 90% attach rate in terms of what we're doing on networking. Now let's step back.
What did we want to show you with a new way to think through what we're doing? You get asked all the time in terms of what percent of our revenue was the hyperscalers. That was, we had indicated for many years, many quarters, indicating that it's approximately 50%, plus or minus any single one quarter in terms of what we see. We are growing underneath that. When you're saying it's 50%, that full growth coming from the hyperscale is there. They're a very important group in terms of what they have done in terms of standing up clouds. What's interesting is the other 50%. And this is what we brought attention to, which is unique to NVIDIA in terms of our AI focus clouds. Okay?
What we're looking at in terms of this group, in terms of the ACIE, is what we are calling it, is a focus in terms of these types of AI clouds. These AI clouds are newly standing up, not a general-purpose cloud that has been there, but focusing on either AI factories, but most importantly, focused on our reference architecture because they need to know that full stack in order to put that into space. What they've done is a fast-moving capability to serve enterprises, to serve the industries, and serve many of the different countries and regions that we see. We have AI clouds definitely here in terms of the U.S. You see it building already in terms of Europe, and now also big areas in terms of Southeast Asia as well. These are important areas to serve this market.
Folks are not going to move back into their own enterprise's data centers to build this. They need an AI cloud builder. This is where the token generations and pieces will be. Interestingly, that's the other 50% and such a fast-growing, as Jensen actually communicated, likely the fastest growing piece. Both their speed and the need to serve such a big market, you've got that ability now with this group. We'll continue to be providing you that information broken out in that manner. There's a lot of interesting things happening in that.
Got it. What I also found interesting is, yeah, despite this daily debate, discussion, noise about how much ASICs might be impacting your business, your business and hyperscalers, if I have my numbers right, was up I think 115%, right? It was definitely at a very strong place. Are you well represented at all hyperscalers? Is there some concentration at certain ones, where people have custom chips? How are hyperscalers making this determination between where should they deploy their ASICs, where should they deploy NVIDIA GPUs?
Yeah, very good question to talk about the word diversity because if you listen to each of the different groups, they're communicating the diversity. Let's step back and say the king of diversity is probably NVIDIA and everything that we have done because each and every cloud that is there, whether that be a hyperscaler cloud and/or an AI cloud, we are also being a part of them. When you think about the AI model makers, when you think about the foundation models, they are also 100% on our platform as well. We have the diversity of both what the types of models there are, we have the types of clouds that there are. Meeting that together, we tend to be the biggest drawer of the diversity going together.
The cloud operators, they have continued to use us not only for today, tomorrow, but in the future because what they are doing is building a significant amount of understanding of how we have designed at an extreme co-design. Most of them are actually continuing to sell what we have in the cloud for them, whether that be our Hopper architecture, whether that be our Blackwell architecture and our future of Vera Rubin.
What that means, it's sustainable to stand up and we continue to watch it grow and grow in this area that they will be able to serve so many of the different markets because of what we have built in a full ability for them to not only do end-to-end types of solutions, but we can be ready for what we did at the very beginning of ChatGPT to what we are seeing now in terms of agentic. That diversity of all of our different customers is very key. Nothing that any other type of builder really has because we are supported and very helpful for them.
Got it. The next topic I wanted to touch on, Colette, was that there is this perception that as the market is moving from training to inference, that NVIDIA dominated the training phase, that inference is going to be a lot more fragmented. When I look at these kind of growth rates, it tells me you are participating well in it. How do you frame the discussion that is it a fair pushback to say that inference, like I saw this one headline which said, "Oh, the center of gravity is moving from the GPU to the CPU." Right? Are you starting to notice a different kind of competition as the market moves towards like what percentage of your business today is in inference versus training, as an example?
Okay. Let's step back on the two pieces here. Basically thinking about there's a training part of it and there's an inferencing part of it. The inferencing part is extremely important for many of these model makers or any of these new companies starting. Why? Because once you're moving to inferencing, now you've got revenue. As you've seen the growth right now in agentic types of solution, the only way to describe it is the growth is vertical. The percent is not the most important thing. It is vertically going up in terms of that. Once you reach a point that you are now at revenue, the most important next thing that you want to think about is how do I make sure I can get a profit? How can I make sure that I am using the best of breed in order to serve that?
For those tokens, I want as many tokens as possible in the shortest amount of period of time, and I want the most efficient.
Right.
Use of that type of compute. That's where we come in. When you think about our systems, they've all been designed thinking about these models, thinking about the full software stack that is also necessary for it, but being the most productive as well as the most lowest cost. This inferencing is not any easier. It's actually harder if it is just a static ASIC because we have been continuing to design over and over again. We still look at this as helping them focus on what type of use they want to use for the inferencing, because it's not that simple that it's one case as well.
As you're working right now that says low latency as we go forward, there is a piece of agentic that says, "I'm going to go back to the director of the CPU and ask that CPU to assist in this piece of it." Again, that hard work is still going to be necessary on our full end-to-end systems and with that important part of the GPU as well. What percentage is of our inferencing? Almost every one of our systems, both is using for training, but is also easy to move over to also do inferencing. With Grace Blackwell was the first time that we'd also seen inferencing first for some of the systems that are built.
Most of those AI model makers that you see right now and the models that they've put out there, Grace Blackwell is very key for much of the inferencing that is happening.
Got it. One other thing that I've noticed is, over the last few years, we saw a lot of deployments, and I think it was harder for investors to connect the dots to ROI and monetization. This year, we have actually seen much better. Is that a fair representation of what's going on? What are you hearing from customers? Are they noticing real ROI now? What has created this switch?
That's correct. The ROI has absolutely represented a significant amount with the cloud providers. The clouds were already making a great return as they continued to sell on the cloud. Now, when you are also supporting those foundational models and what their work is doing in agentic, you are seeing not only enterprises focus, but you have the entrance of consumers as well.
Right.
Folks working on agentic types of work, even at a personal level, is also very key. That is enabling the revenue, which is therefore enabling more and more profit that allows them, again, to serve more. Most of them right now are in a position that says the compute is tight. There is still a shortage of supply of compute stood up that they want more and more that they are trying to get, we're working with so many of them to help them as this agentic plan that we knew would be a great part of the next stage is actually almost a greatness that is causing, again, more and more compute needs. We're going to work very hard to serve many of that.
Got it. We have seen just insatiable demand from these public LLM companies, if I can call them that. The skeptic will say that they are trying to get their hands on compute wherever they can find. Does it not mean that hardware, to some extent, is being commoditized because of that? If they don't care whether they're using a five-year-old GPU or the latest generation GPU, they're just trying to get compute, whatever. Does that speak to commoditization, or does that just say that there is just a-?
It's actually the opposite.
Nice.
It's actually given that full strength of agentic, it is forcing them to say, "I've got to find the best of breed to do that." I agree that they're working on many different solutions to try and put that together, but you really have to look at where would the lion's share of that come from. We tend to continue right now growing our capabilities, growing our ability with more and more supply, and we are serving a vast majority of what is needed right now in this agentic role. I think that's going to continue. The perception that, hey, any chip will work, we're not a chip.
It does take a full end-to-end data system to do that, because you really have to think about the work that it needs to be done in agentic starts at the onset of the information landing in that data center all the way through to the end. No simple one chip would be able to solve that. We think about all the seven different chips that we'll even have with a Vera Rubin, fully designed for these types of solutions, that we can answer all different types of questions all within one full system. That's why we are continued to be looked at. We have certainly engaged with a lot of different companies, matchmaking with them, where how can we help them both obtain the land, power, and shell?
How do we help them in terms of standing up the compute as fast as possible for what they need to do?
Got it. You mentioned land power shell. Those are very well, I think, recognized constraints. Do you think they are constraints to a point where your existing customers might say, "You know what? It might make more sense to just upgrade my existing GPU infrastructure." Has that upgrade been a factor so far? When does it start becoming a factor?
It's an interesting debate that says you have data centers that may have already incorporated the Hopper architecture. What is interesting right now is the Hopper architecture in the cloud is actually earning more money than the very first day that they had it, because that has been something that has continued to improve, whether it be Hopper, whether it be Blackwell, and you're going to see the same thing with Vera Rubin. We continue to improve it with software to align with what currently is happening in the market to provide that with inside those systems. That is actually helpful for them. The depreciable life may be a certain amount of time.
Right.
The useful life is very long. If you think about it, why they want to keep it up and running, the time down to then build another data center versus this is actually quite useful for us is much easier for them right now. Particularly in this time, the brand-new data centers are also important because you want your best on that. If you spent hours, years trying to find the exact land, power, and shell, given that it can be a very tight area right now to find.
Right.
You're going to want the best. You're not going to sit there and say, "I'm going to use something and give it a try." They know that NVIDIA's architecture has continued to ramp for this, and that's why many of them are on that plan for all of these different data centers.
Got it. Right now, to your point, the focus is obviously greenfield. It's a lot of the newer products, and then existing, it's try and get as much. Right? Upgrade is not yet a factor. Do you think there is a point at which that trade-off makes more sense, that you can generate so many more tokens, right, and generate so much more revenue that that offsets whatever depreciation benefits you could get from an older generation product?
At some point it will get to be there, but it's an interesting time right now, given the tightness. Those new data centers that are being built are absolutely built with the most sustainability, but also thinking about the efficiency of power, and most of them are liquid-cooled. When you're looking back in terms of a Hopper, you'd have to change that data center. It will happen. They will move that, but right now, moving ahead, getting ready for Vera Rubin is what the key thing they're doing.
Right. I'm glad you mentioned software because I find that sometimes that is sort of underappreciated about the full stack aspect of the platform, right? The reason one can extract a lot more value, even from existing hardware, right, is because of that constant innovation in software. Maybe talk to us about what is the role of software? What is the role of having all these domain-optimized libraries and developers? Because sometimes I find that people just kind of treat it with a throwaway line of, "Oh, the CUDA moat is broken." I imagine it's a lot more than just one operating system mode.
If you discuss with any of the foundation model makers or any of those creating these types of solutions, they are all focused, yes, as the underlying CUDA, but those key things is the domains and the libraries of software that we have. With you think through any type of AI cloud that is standing up. One they're working on, can I design a data center? Can I stand this up? They need a full end-to-end architecture. They don't have thousands and thousands of software engineers that for over the last 20, 25 years, have designed software that is both backwards compatible and forwards compatible.
Right.
As much as they are leveraging this in CUDA. Our work in terms of those libraries for each of the industries, each of the enterprises, is going to be fundamental, particularly to the AI Clouds and the work there. They can get a full stack. They don't have to rethink, redesign it. It's more important to that, even within the cloud, and you have the foundational models in the cloud. They, too, are also very keen onto that stack of software that we are working together with them to continue to enhance. We have our own models with inside NVIDIA.
Right.
Those models are leveraging our software and building upon our software because we do also understand how models are working.
Right. Absolutely. None of that is something that ASICs can do.
Absolutely not. It doesn't have the ability. It's affixed. It was determined at the point that they went and designed it, the time that they went to go tape it out, it's done. It doesn't have the ability to change over that. We have that because we have a full platform to revise any part of that from here and going in the future.
Got it. I wanted to touch on two more topics in the last few minutes. One is on constraints and then the CPU side. On the constraint side, given the strong growth that you're seeing, what are you doing to. Are there constraints? Like what is the constraint? How are you dealing with it? And can the fact that you have prepared for it, is that a competitive moat by itself also in this industry?
It's been interesting to watch as we knew the growth, and we have been continuing to talk about the growth going forward. Remember, we think about 2025 through 2027. If we think about Blackwell and Rubin together, that's $1 trillion. We knew that. We knew that that opportunity would be in front of us, and we knew it would probably exceed that. What that means is you have to be thinking about your suppliers, your full ecosystem, because I would say it's not just the supplier piece of it.
Right.
You also have to think about the land, power, and shell as essentially a supply. It is a principal piece of what we need to do to complete. Our work is longstanding. Our supply is not just ordering what is there. Remember, often we are in deep design with many of our different suppliers at the very onset of what we are putting into our full systems. That design product is working with them way ahead of where we are now in market. You would say probably more than three years ago, those are where some of those discussions started.
Right.
That is a continuous, ongoing focus in terms of the supply we need. We have some significant amount of purchase commitments. It's a number that I don't think any significant company would look at that and say it's a small number. We're essentially at about $124 billion of commitments.
The entire logic semiconductor industry was that a few years ago.
It's an enormous number. Keep in mind, there's an ongoing every day. You never know what day you are fully where you need to be from a supply. Demand arises the next day. We're in that continued discussion with our suppliers. No one's immune to the supply constraints. We all have our continued work trying to help them with it. Given our size and given our longstanding work with them, we can continue to think long term with them. It's important to understand, it's not necessarily how they divvy up supply. The question is, how do they stand up the capacity? The manufacturing lines to continue what they're doing, and that's where we often come in. How can we assist? How can we help you understand what is going to be necessary? Their first question is, how many manufacturing facilities do I need?
Right.
To support NVIDIA? It's an important area. I can make the same type of statement for land, power, and shell. How do we help them stand that up? How do we align that with people that are interested and didn't have enough compute.
Right.
Now need more land, power, and shell. We can also be continuing to work that ecosystem as well.
Right. Despite the inflation we see in everything around us, you think NVIDIA can sustain the kind of margin levels despite all this because of the planning work and pre-purchase commitments then?
Nothing as we see moving forward changes to where we are today. Even when we think about putting Vera Rubin in market. We have done so much work and is very well appreciated with many of our customers, both on the manufacturing side and the cycle time. How long will it take me to get this product into the first day of revenue from what they're putting in together? They've actually really seen a true difference. We're on our third generation, and that is moving very fast, but also very efficient, not just focused on the system, but the full manufacturing of what it takes to get that up and running and fast. At this time, I don't see anything different going forward. Does this continue for us? Yes, we'll find out more later, but that's where we stand.
Understood. Before I ask about the CPU, one other thing I remember from what was said at GTC Taipei was the ability to improve monetization per gigawatt. I think there was a roadmap given from $40 billion towards $60 billion-$80 billion. What is driving that? Those are pretty big numbers, right? Pretty serious. That's like your content expansion with every new generation.
Every new generation takes more and more focus on every last piece of that system and getting it accelerated. Okay? Not focusing on a very single one chip. One of the comments we've made in terms of Vera Rubin, it's seven different chips. When you think about the importance of just the switching capability, the connectivity of moving, how fast can we move things across? How can we make sure all different types of asks of the compute are being held and accounted for in terms of that? That's where the CPU now becomes an important part in terms of how we put that in there. It also thinks of all of the different switches. It thinks about in terms of the adapters and pieces of that. You've got a BlueField opportunity included in this.
Then also what we can do just from a sheer GPU and the overall development of that. You bet, we're going to continue to see, not just because we're focusing on the chip, is because you focus on that full data center and that capability.
Makes sense. Just the final topic in the last 90 seconds, which is on the CPU side. What drove your decision to invest in the CPU? It's not the biggest part of the content. What has made it more important? By investing in Arm, you were using X86 in many of the head nodes before. Why not just continue to stay with that?
Yeah. The design that we've done is very well aligned to agentic type of solutions, that verification of the agentic work that needs to be done. The hard work sits with that GPU, and now that CPU is really right in line for what that's going to be necessary. However, it doesn't mean that you just want to build something off the shelf, because you still want that connectivity of the software. How does all that work together? It is more performant. Remember, it's a 2x more performant, which is an important piece.
Right.
It is also our own cores in terms of what we put together. Okay?
Right.
If you don't mind, I'd love to take the last.
Please.
30 seconds here.
No, please use as much time.
To remind folks in terms of where we've really gotten to in a very good place in terms of returning capital to our shareholders.
Yes, of course.
I know. It's a really great opportunity. You know that we've had to focus in terms of on our suppliers, our ecosystem, to build so much of what we've done. Given now where we stand with a significant amount of cash flow generated from these full systems, the amount that we can return to shareholders, 50% or more, absolutely is a key focus of ours. Not just for today, not just for tomorrow, but for the long term, we'll continue to focus on this. We also added the dividend. Our dividend has been with us, yes, for 13 years.
Since you joined.
I think so that is correct, as far as when it started. It's now time to also serve a very important market that also has the ability to, from a capital return, choose in terms of our dividend as well. A great opportunity for $1 a share per year, and that is, again, an area that we will continue to focus on for growth, not just our share repurchases, but also our dividend. I just want to make sure that we're clear with that.
Why limit it to 50%? Why not 75%?
We're working on it, and we'll let you know in terms of there. How about we'll go through this year on $1 each?
Maybe next year when you're here for the keynote, maybe by that point.
We'll come back next year. We'll talk about it.
Okay.
Sounds good. Thank you.
Thank you so much, Colette. Really appreciate your time.