- info
- Transcript

John FurrierHello everyone. Welcome to theCUBE Pod episode 90 Dave and 90th episode. I'm John Furrier with Dave Vellante. Dave salute. Give the salute, the Dave salute.
Dave VellanteHow you doing, Johnny?
John FurrierGood to see you. It's been a great week. Oh my God, first, I was watching football on Sunday, Saturday night, my texts start blowing up. This DeepSeek has been taken over the internet and really so many storylines on this. I was commenting on this at a presentation I did in Silicon Valley this week. But DeepSeek has taken over the narrative and it's from China, and so it's a whole nother thing. And it really put everyone on notice around AI efficiency and also the geopolitical thing from China. Is it a psych ops thing from China? Is open source going to change the game? There's so many storylines. Is it a breakthrough. We're going to get into this, the efficiencies interview with the Chief AI officer from Cerebras. He weighed in on this. They have a clear line of sight. Amazon Web Services added DeepSeek R1.
Everyone's adding it in. Apparently it's the best in reasoning and doing some other efficiencies with chips. I called the chip grid. We'll get into that. But just a lot of action this week. I think we'll dedicate this pod to a deep dive on DeepSeek. So much angles and a lot of things we've been talking about. For the last two pods, we've been riffing on things like NVIDIA's mode and we were even going back in the history books and talking about many computer and proprietary operating systems. And remember those debates? It all played out. And then TikTok got banned for a day and then boom, that was a China discussion. And then China launched, in my opinion, it's salvo with DeepSeek. And I think it's the beginning of what we've been seeing as a cold war, but now an arms race. We're going to get deep into that. So if you really want to get our take on DeepSeek, there's a lot of threads.
Threads we've been covering. We've been covering as an analyst, but also commentating on speculating around fusion models, models working together with distillation, power law of AI models we put out two years ago. Those predictions still stand true. In fact, if anything it's validated more of our original vision on that. So, so much going on in this AI arms race, again under the hood, just some great stuff, but also some really interesting political conversations around DeepSeek. So Dave, we'll get into that. But first let's knock down some news because some other stuff is always going on. You had the Juniper lawsuit by the DOJ for blocking the HPE merger with Juniper Networks, which is ridiculous.
Dave VellanteIt's unbelievable. Really?
John FurrierAnd then IBM, Apple, Microsoft, Meta and Intel earnings. We'll get into that. But let's just start out with just quickly unpacking what I thought was a big story, which I thought HPE should respond when I saw there was a block of that merger, which seems like a no-brainer to me, but now the DOJ is suing HPE.
Dave VellanteAntonio responded. What kills me, John is the UK Competition Committee basically said, yeah, it's okay, do it. And then they're basically saying that, "Oh, that HPE and Cisco would be dominating the market for fixed wireless." And I'm like, "What?" Cisco is the dominant networking player. Antonio responded saying the DOJ is just narrowing the market definition way too much. I totally agree. I think this is really overreaching by the DOJ. And I don't know which DOJ is it? Is it like the Lina Khan leftover or is this Trump knuckleheads not understanding the market? Maybe it's because Antonio hasn't gone to Mar-a-Lago. I don't know. Maybe he's got to go kiss the ring.
John FurrierNo, it makes no sense. It makes no sense. ZS Carvalho wrote a post on this. Even if there's no market power here, and then people were chiming in about the WLAN market, wireless local area networking, which is Wi-Fi basically, stadiums and that kind of thing. But absolutely, I see no problem with this deal. To me, this is as uncompetitive takeover monopoly as you can see. HPE, even with Juniper, still has a huge competitor in Cisco. So if anything, Cisco is the big whale. So how does this work? I mean, it just doesn't make zero sense to me. This is, again, I think a display of incompetence on the government, just bad policy. And I watched some of the Senate hearings by the way, and you want to talk about just how there's no decorum anymore.
It's just forget qualifications, you want to smear people. So I think we're going to swing back to he original principles of like, "Hey, let's get information. Let's do the right thing and let people do their business."
Dave VellanteCan I just comment on the Senate hearings for a second? I watched a bunch of them too. And it's the same thing, whether it's a Democrat, a nominee or a Republican nominee. The other side just goes, "When was the last time you beat your wife? Yes or no? It's a simple yes or no question. When was the last time you beat your wife?" It's like, "Wait a minute. At one point RFK said, Senator, you just asked me six questions. Just let me answer one." "We don't have time. Yes or no."
John FurrierNo, no. When they try to defend and they get cut off, I got my soundbite in. No, it is basically a humiliation. It's a game of humiliation and they want to get the soundbites in. But if you look at the candidates from the Trump side, they're playing and we have a mandate. And they're going offensive right out of the gate. All of them I did. I watched all of them pretty much come out the gate knowing it was coming. But again, it just shows that the government, I think there's going to be a reset. I think people want to have a reset. I still think there'll be the bipartisan natural thing that happens, but the world was coming this direction. I've been saying to my kids, I've been saying as long as I can remember on theCUBE that there's going to be like hippie revolution in digital, in this culture where the young generation is going to say, "I've had enough. You boomers left me all this mess. Come on.
" And so you're starting to see that narrative and that Trump Traction. His approval rating in Democrats is off the charts and most of the young kids love him. So
Dave VellanteThere's a lot of detractors out there still.
John FurrierWell still, but you see a lot more of the people speaking out and it's less hiding. So you're starting to see younger people, just whether they're buying whatever narrative, it shows a different sentiment. And I think it is because of the obvious mistruths that have been represented on both sides. So it's not just Trump's side, it's just the other side too. So I think there's some things out there that young people just can't get their arms around. And I think my philosophy is just invent the future, create a new future. And if I was in my twenties, I'd be like a rebel too. I think I would probably rebel against the system and look to create change. Steve Jobs had that famous quote, "The world we live in was created by people that were no smarter than you." And I think that applies to government and I think it's going to be, not in a Kennedy way, but I think it's still not yet formed. But you might see that. That's what I'm just saying. So my point-
Dave VellanteWe'll see what happens. It could be a lot of unintended consequences of shifting responsibilities or cutting. My fear is that they're cutting stuff for people that are protecting Americans, whether it's cybersecurity or critical infrastructure, or hopefully not terrorism. I don't know. It's just, like you said, Trump's on the offensive. He blamed DEI for the crash, the helicopter and airplane collision. I'm like, "Oh, okay, maybe." But I don't think so.
John FurrierThe analysis of that is actually fascinating because people in aviation are very technical and they weigh in. It's a combination of system issues and also just common-sense flight path. It's just-
Dave VellanteHuman error.
John FurrierIt's just a really, really tragic thing. But it could have been avoided. That airport, I fly into that all the time for DCF because it's a shorter <inaudible>.
Dave VellanteMe too. Me too. It's so convenient. But it's like maybe we'll be flying into Dulles.
John FurrierI'm like, maybe I could go to Dulles now. Because the traffic there, I mean it is so busy. I don't know why they're running training runs on Blackhawks. It makes no sense to me. They could probably do it somewhere else. And they're all wearing night-goggle visions, by the way, in that too, and it's lit up heavily. So it's like that's a whole nother thing. I don't want to get into that, but I'm scratching <inaudible>.
Dave Vellante<inaudible>.
John FurrierAgain, DOJ government inefficiencies. We'll put that aside. I'm for HPE buying Juniper. I think that's a good move for HPE makes more Cisco's probably cheering. But other than that, that just again makes no sense.
Dave VellanteBut here's the thing, it was a year ago. You remember we had the CEO of HPE, the CEO of Juniper on at MWC last year, which was what? February? It's been a year. Come on. Why does it take a year if they freeze? They make all these plans. Really, you can't figure this stuff out inside of a year. Anyway, I'm very much against it. I don't really understand it.
John FurrierBefore we get into the DeepSeek stuff, I want to just hit on these key earnings. Because we like to watch the bellwethers, IBM, Apple, Microsoft, Meta, Intel, all released Dynatrace as well. We covered that because they're in our observability area <inaudible> great earnings. IBM.
Dave VellanteIBM guidance was really strong. When I saw DeepSeek come out, I'm like, "Ah, a little bit like Granite." So I thought that was a nice little boost. Not that that's why the stock was up. It's up because they gave good guidance.
John FurrierAnd I think IBM just has fundamentals. We saw Arvind Krishna, we've been to the analyst meetings, we cover them. We've had one-on-ones with the executives. IBM has been really focused on being that integrator and some picks and shovels in the AI wave, and they got the install-based customers. I think we've mentioned this on the pod how many times, but in AI and this transformation, you always say the line is you win in transformation in transitions. So this is IBM in a transition with the industry market shift. They have a lot of customers and they have a lot in their portfolio. So they sharpened the saw. And they did, they got good results. And maybe that fruit is coming off the tree from Arvind's strategy. And again, he's pretty meticulous about what he's trying to do. Clearly the long game. He said to us many times, "We're playing along." The big open item for me is the developer.
So IBM has the install base. Startups are trying to sell into that install base. IBM has an opportunity to bring that developer go-to-market piece in, as does the Dells of the world. And so I think that the big incumbents, Dave, are shifting from trying to win the developers, the code on their platform to coding into the stack of their systems and their transformational install base. Because people aren't changing out the tools and platforms. They're changing process, not so much changing things. And you see in the abstractions come in. So I think these incumbents like Salesforce, like IBM aren't going anywhere. They got the data, they got the install base, they got the beachhead, they got the position. They're going to be brokering access to new technologies.
So I think there's going to be some durable incumbents. Andy Jassy used to call the incumbents the old guard. I think it's a good opportunity for them. So I'm bullish on it.
Dave VellanteAnd the software piece is what excited me. Looking back, the Red Hat acquisition, I always thought that the Red Hat acquisition made sense from an IRR standpoint. Stu and I were in here. Stu of course works for Red Hat. During COVID. We did an analysis of the 34 billion. And at the time we said it's really not a cloud play. Maybe eventually it could be, but it's really a play about leveraging Red Hat and OpenShift in their consulting business. And that's how this thing's going to get paid for. I criticized Ginny a lot, but this is on her way out. She let Arvin do that. Not that I said, but Arvin was going to be in control anyway. But that was a good acquisition. The numbers made sense. They paid for it very quickly because of the consulting business. And now the software side is really paying dividends. So 34 billion, a lot of people criticize that acquisition. In my opinion, it was one of the best in IBM's history. Maybe will turn out even better than PwC, which essentially saved IBM back in the Gerstner days.
John FurrierYeah, IBM's doing great. Apple had earnings, Meta had earnings. It was a leaked to all hands. Zuckerberg was saying, "Every time I give them all hands, everything gets leaked to the media." So it's a bummer
Dave VellanteComment on Apple. We've been saying for how long everybody ebbs and flows on Apple. Down on Apple, they've got such a huge install base and their services business is the marginal economics or software economics. Maybe even better. It's amazing. And that's what's driving their business. Their install base is growing. Maybe iPhone sales are suffering a little bit because of China, but the install base I think grew by over a hundred million, I saw. That's incredible from the last time they reported it. So that's the service revenue. And whether it's ear pods and billions and billions of dollars on products that or are relatively low cost and loved.
John FurrierYeah, I think there's going to be a big, big focus on how the impact of this AI shift happening quickly to the big guys. So we're going to keep watching that. We'll hear our comments on the pod.
Dave VellanteAnd I heard a stat that the iPhones that did Apple Intelligence actually did better. I don't know if that's true. I got to dig into that. But if that's true, I don't have the latest and greatest iPhone. Mine's a couple generations old. And so I'm one of the reasons that people say, "Oh, Apple's in trouble." because people aren't upgrading their phones as often. But if Apple Intelligence is that good, I'm all in.
John FurrierWell, my family wasn't giving it high marks.
Dave VellanteYeah, that means it's a Siri 2.0, so we'll see.
John FurrierAll right, well let's get into the deep dive of this DeepSeek situation.
Dave VellanteOh, couple other things. Microsoft earnings, so guidance and spending with the concerns there. Azure missed my forecast. Intel beat, and everybody's excited about Intel, again, the stock was up, but the revenues declined 7%. And ServiceNow, surprised to the downside. I was surprised to see that tepid guidance and they missed on revenue. So yeah, big earnings week, a lot of news. And then OpenAI, my gosh, we're going to talk about that I presume when we're going to get into DeepSeek.
John FurrierYeah. Well what's your take on those earnings based on those numbers? What's your analysis?
Dave VellanteIt's going to be interesting. It's a little mixed. This happens when you go through these industry transitions. It gets very confusing. You have some companies are doing really well, other companies are doing okay. Those with the big install base. Sometimes they struggle. IBM bucked that trend. Microsoft was kicking butt. So you have all these cross currents. And it's very chaotic right now. But in general, I'm optimistic. And I think, we'll get into DeepSeek, I think that we're going to learn from DeepSeek how to do things more efficiently in AI. And that's going to be a rising tide that lifts all ships finally. Because AI hasn't lifted all ships as we know, it's been narrow and focused in terms of those that have really gotten benefit from it. I think to the extent that we can lower the denominator and we're going to talk about that, the value goes through the roof.
John FurrierYeah, I think anyone who's in this game has invested the CapEx or the infrastructure, the levers are infrastructure and software. And I think the CapEx, whether it's data centers, AI systems that's continuing to thunder along and people are trying to figure out how to put production workloads on them. And it's the software innovations, I think that's going to be key. And what got my attention with this DeepSeek was there's a lot of salacious headlines, but at the end of the day, it was the innovation behind the model and how they did it was interesting. First, the thing that got everyone's attention was the cost claim. They had outstanding numbers. And this unbelievable, "Oh my God, 5 to 6 million dollars. Oh the costs." that cost hundreds of millions of dollars for OpenAI. That was the first strike of the play, which by the way, NVIDIA stock dropped on Monday.
Largest loss in the history of the market. If someone shorted that thing, they made tons of bank. Now, by the way, High-Flyer was the company behind DeepSeek, a hedge fund, but spun out DeepSeek. And that to me could be suspicious. But again, the top stories were the training costs, that was debunked, the efficiency behind the model. How they used chips and how they did some precision work FPG&As and other chips, not just GPUs, although they had GPUs. We'll get into that. And then the broader narrative around the democratization and the commoditization of models and the CCP-linked involvement. Those were huge storylines. So that was the table. So DeepSeek announced their model and it set the stage for this conversation.
Efficiency versus raw compute. Do you throw more GPUs at it? Many people are telling me that a lot of their GPUs are idle. It's like cycles are idle. So this democratization is a software innovation, it's an algorithm automation, it's an open source innovation. So this is what was the key discussion. Once the sizzle was debunked, Dave, it went into that. So on the surface it looked good, but when you peel back the onion, you unpack it, it grabbed a ton of attention, 14.8 trillion tokens, and these figures grabbed attention. And everyone's like, "Whoa, whoa, whoa." Who actually did the analysis? There's a company called High-Flyer, a founder was a member of that hedge fund in China.
Dave VellanteYeah, Liang Wenfeng.
John FurrierAnd they spun out DeepSeek.
Dave VellanteTo your point, you think he would short NVIDIA on Monday?
John FurrierSomeone had to be. How do you fund this?
Dave VellanteWell, exactly. I think that guy made money. I don't have any <inaudible> or facts probably. Well, I mean I think he wanted attention. He certainly got it. And I think who knows. The Chinese government's probably right there with them saying, "Hey, let's watch this." And they're talking about... What do you call that when you throw a little disruptive explosive, a Bouncing Betty into the network? That's what happened this week.
John FurrierSo it really was crafted story. It was an illusion in my mind of a low-cost innovation. And it really wasn't a low cost. They actually paid for it. And now they're tying together through our analysis and through the reporting. SiliconANGLE is High-Flyer was involved. But to me, I think the real innovation was smarter, leaner, faster models. And that's what really the secret is here. And by the way, the whole China conspiracy theory, although I think this is a psych ops in my opinion, but not the way people think it is, it's China getting back in the game and flexing. But this team is not just a side project, it's a legit group spun out by High-Flyer. They shared resources. We'll get into the GPU audit in a minute, but this was definitely not a low-cost situation. Now they did distill off of OpenAI. We'll get into that.
But to me, this was no fluke. And here's what they did. They did a smart model design, mix of expert. That was the first big thing. The traditional AI models like OpenAI use brute force number crunching. And not DeepSeek. They did the mixture of experts. They also did the distilling of other models. So they didn't have to do the brute force crunching. And they slash memory energy and the time it needs to get the answers and reason with good performance without compromising performance. They get all that stuff. It's a game changer. A lot of matrix multiplication involved. So you had floating point precision in there, FP8. This is where you start to see FPG&As potentially coming into the mix. So what they did was they just did use different chips.
They used H100s. They didn't use H800s, I should say, not the big expensive H100s, although they probably did do a little bit of that on the big training. And they used FP9, which is precision floating point capability. And then they did great compressed attention, which is the memory management. So current AI models chew up a lot of memory. DeepSeek avoided that with what they call multi-head latent attention, compresses memory. So a lot of memory work. And then they optimized around H100 GPUs, which aren't as powerful as H100s. And so they optimized the chip-to-chip communication to offload the constraint of that chip, which is a memory issue. H100s have better memory. And that's what they did. And they just accelerated their multi-token prediction, which is essentially the training time.
So DeepSeek actually did something good and that was a big deal. So this is why I called it the chip grid because what they did was it reminds me of they did a combination of things that weren't obvious. Very clever, very good engineering. I don't think it's a breakthrough in a major way, but it was something that they did with the constraints that they had, which was they didn't have the big mother chips, so great tell sign for me.
Dave VellanteWell, did they or didn't they?
John FurrierWell, they did use the H100s. Now the training side, that's different. This model, lower cost, now open source, we'll get into that, but actually does really, really good reasoning. And that's why the precision floating point stuff is important. They actually did a lot of good, fast low cost. And so they're changing the game on the infrastructure. Now you want to get into the training. If you look at the data that was reported out and the analysis shows is that when you look at the number of H100s they had... Let me pull up my stats here on this one. This is worth reading because it's very specific.
Dave VellanteWell, Dylan Patel tweeted that said he thought they had access to 50,000 Hopper GPUs. The 10,000-
John FurrierSo the SemiAnalysis blog had the great report on this. He quoted, and others are validating, they had around 10,000 H100s and about 10,000 H100s.
Dave VellanteA100s.
John FurrierDistributed-
Dave VellanteA100s, right?
John Furrier10,000 H100s.
Dave VellanteAnd then supposedly people saying they had 10,000 A100s, but I heard-
John FurrierNo H800s, they had tens of thousands of those. And 10,000 H100s, the bigger GPUs, distributed across training inference and research ops. So they had a distributed architecture. And they have orders in from what he's reporting for about more GPUs from NVIDIA, the H200s. So this is GPU sharing between High-Flyer who was the customer for that?
Dave VellanteYeah, supposedly they had access to 50,000 Hopper GPUs.
John FurrierYeah. Yeah. And that's huge. That's about a 1.6 billion CapEx. Okay, so now that whole cost thing goes away.
Dave VellanteWell, and I saw what happened at NVIDIA's stock and it's still bumpy. This guy Epstein... No, sorry, Jeffrey Epstein, Jeffrey Emanuel put out a post, a short case for NVIDIA. It was an hour long read. It was very, very long. But basically he made the bigger case. He's a former quant. So he was probably short the stock <inaudible> into Grok. Loved it. But he basically didn't say anything new. He talked about NVIDIA's high margins. He talked about Cerebras, he talked about alternative software, he talked about the hyperscalers doing their own chips. He said TSMC can sell to anyone they want. But I read that. I'm like, okay, but the only way that there's to my mind that there's a base case for NVIDIA is if you believe that demand for compute power will wane because of this.
And I don't. And that's where I think Satya was right on. He tweeted out or whatever posted Jevons paradox in this case, I don't think it's a paradox. Cost goes down, demand goes up. People buy more. To your point, AI gets more democratized. It's all about the value. So think value, very simple. You got benefit over cost. If you can lower the denominator, if Satya gets more out of his 80 billion, then that's more value. If he only has to spend 40 billion, then he's got 40 billion left over to spend elsewhere. His ROI just went up. And so I think that it's all about value and volume. And I think saying, "Well, TSM can sell to anybody." Well, NVIDIA has the volume lead by far, unless you don't believe that the market is dramatically transitioning to massively parallel computing.
I.E. accelerated computing. If you don't believe that, okay. But if you do believe that, then the demand for compute is going to be virtually unlimited. I've been saying all week we sent humans on the moon with a computer that had the power of a calculator, maybe even less. Certainly much less than our phones. And so we've seen since the '60s and the seventies and the eighties, demand for computing power has just been insatiable. And I don't think that's going to change.
John FurrierI think it's just going to lower the cost and drive adoption. It reminds me the online population on the internet has got more, the performance got more. And I was talking with some entrepreneurs this week. And you know how the classic AI trajectory people are like, "Oh, it reminds me of the web." These critical moments. The one entrepreneur said it reminds them of the iPhone revolution because the user experience shifted and that drove a lot of change. And we've said it here in the pod, that there's a backend, front-end transition happening at the same time. It's both the infrastructure and the front-end software. So the levers that are being pulled right now in this industry that are significant, where the money's going to be made and won or lost, and the battle will be established is on the infrastructure side, which is AI infrastructure, which we've been saying and reporting on with SiliconANGLE and theCUBE research.
And then on the software side, and this DeepSeek represents the software side. What they've essentially have done is they've innovated in using off the shelf hardware in combinations, whichever stand you have, whether they use High-Flyer or not, they actually did some innovation. But it wasn't major breakthrough engineering. All they did was use the constraints of the H800s, which they could get from Singapore or whatever channels they can get into China. And they made it better. Now that creates a different efficiency on the memory and energy, which is great, which lowers the overall cost. And now when they distilled with the algorithms with OpenAI, they have a fast model and reasoning model that allows the software to work better. So that isn't important.
So this is a software algorithmic innovation in my opinion, that's going to drive a hell of a lot more demand and it's going to make the hardware more valuable. So the flywheel between the infrastructure providers, whether it's a Cerebras or Dell AI factories, they're going to move faster from what John Rose, the AI chief AI officer at Dell calls POC purgatory. All these major projects are stuck in purgatory. They're stuck before they get the production. Now, as you have the software innovations on the front end, like that iPhone moment, you have the applications using the user experience driving in on a collision course with the AI infrastructure. And that's going to create, I think, a major uptick in usage and demand.
Because now viability is in there. So all the hurdles around cost go down, energy can be managed with the power envelopes. You can have one megawatt rack and then have little other racks. You can organize your equipment differently on the hardware side because what they did, distributively, unlike the centralized approaches, was innovative. So I think this is a software innovation and the fact that they open source it, Dave, is the key point. So people were complaining out of the gate on this DeepSeek like, "Oh, China's taking over. It's a war." Why would you use it and send your information to China? Well, it's open source, you can download the weights in there. Now what they didn't tell you was it was very opaque on the training data. So there was very much some stuff that's still open that people are nervous about.
Not everything's available, but you can use the weights. And you can take that and put it on your servers. So Perplexity, CEO weighed in on that. He took the model from open source and put it into Perplexity. Amazon's adopted it. So it's not directly dependent on the China servers. That's false. Now, yes, the original version ties to the China servers. But because it's open source, you just grab it. So I think that's going to drive application developers big time. Totally going to crush that because it's a little bit opaque on the open source side. That's definitely clear as far as I'm concerned. It's like, all right, where's the open source? That was the big question. Where's the open source, right? Okay, training data, they didn't release the data sets, but they released the weights. The distilling process. They distilled off OpenAI's outputs. They still haven't explained it. And then-
Dave VellanteWell, they use this thing called mixture of experts. I'm like, how long have we been talking about MOE? And Amazon talked a lot about model distillation at re:Invent this year and bringing capabilities. But look, I think it was a copy paste with some really clever ways to more efficiently use the constraints or get around the constraints that they had. But again, other than is it a Sputnik moment? You had said you didn't really think so.
John FurrierI didn't say that. Marc Andreessen said that. I was against that because he got called out. Sputnik was country on country, but they didn't release their plans. But if Sputnik had open sourced how they did it, then it would-
Dave VellanteRight, but you're saying it's not a Sputnik comparison?
John FurrierNo. No.
Dave VellanteYeah, I agree with you. That's what I'm saying. Again, people are saying it's a Sputnik moment. You and I agree, it's different, not really the best analogy. But it does underscore that it's got a good wake-up call. Let's go. Do you remember when in the '80s, Japan's ascendancy was freaking everybody out out? And I think this is significantly more competitive because the market is so much bigger and AI is so much more important today. But to me, the winners of the market, the market overall just keeps getting bigger and bigger the lower the cost is. And I don't see NVIDIA as a loser. I was surprised. I understand the NVIDIA sell-off, but people that were traders in the market for years, friends of mine were texting me. He's like, "DeepSeek competes with NVIDIA. Should I sell?
" I'm like, "No, wait. No, they don't compete with NVIDIA." But that's what people who don't really understand think. That, oh well it does compete indirectly is the logic because it means you need less.
John FurrierThey use NVIDIA's chips. And they have more <inaudible>.
Dave VellanteThey're going to sell less is the logic, but that's flawed logic. Because it's Jevons paradox again. And then I think other semiconductor vendors, it's a good thing. AMD for the Edge, when you were hosting that panel at New York Stock Exchange, it was all about the edge. That's where they're playing and they got more memory and all that other good stuff. To your point about infrastructure players like HPE and Dell, I think they win, software vendors and hyperscalers. I think it's good. I do think LLMs not crazy about Anthropic as you know. Full disclosure, I'm an investor in Anthropic back when they had single digit billions of valuation. And I was psyched when they hit 60 billion, but that's not looking so good. I think OpenAI, they're still leader. I see the article in the journal today talks value OpenAI at 300 billion. 40 billion dollars SoftBank wants to put into them. So somebody's willing to put some dough into him.
John FurrierYeah, to go back to your point about the Sputnik moment. I would say that I saw a thread on X I liked. The guy was basically comparing it to more of less of Sputnik because they actually released the open source to more like when Google published their papers. Because I think what's happening here is that it's all out in the open unlike anything that's hidden. Now, they're not disclosing some of the thing, but that's more like what this is. I think it's a first strike in the AI dominance war with Europe. And so I think with China, because I think this is the first easy disruption, disrupt the stock market, open source everything, commoditize, burn the village, get everything down, take down the big guys, in this case OpenAI, they have to up their game. But the fact that they did this was, as I said, and David Sachs said on TV today, it's the mother of all inventions is necessity. So this is a case date where the US chip restrictions was a blessing in disguise for them because they had to get their hands on the H800 GPUs, which they could, they're not as powerful as the H100s, but they didn't just sit there and complained about it, about not getting the big hardware. They innovated, they reprogrammed the H100s communication protocols and they sidestepped via getting down to the assembly language level and managed the bandwidth limitations that held them back. So ironically, the export restrictions might have fueled the innovation.
Dave VellanteIt's like Stuxnet at Natanz, right? When the centrifuges got sped up and they discovered it, what did Iran do? They figured it out and they accelerated their nuclear program. So it's a version of that.
John FurrierIt's like when PC started this in the garage, they just took off the shelf chips and made a smaller computer because their constraint was, they didn't get the big mini computers back when Steve Jobs and Wozniak did that. IBM, same thing. That was skunkworks. But this is what they did. And what that unleashed is and their innovation was an algorithmic innovation, which was how they got the model to work. So because of the hardware constraints that they had to innovate around, they actually saw a breakthrough on the algorithmic side. It was software side. So this is a software efficiency game. And I think that's going to change. That's why all the people that were responding were either the Perplexities of the world or the chip folks. Because they're like, "Wow, I could actually integrate the model. Folks like hardware manufacturers, like Dell, they work on how many MIPS can I get out of the power?
They're not really, this doesn't impact them as much other than they can make their stuff run faster. But if you're Perplexity, and if you're like Cerebras, you're a chip folks, Cerebras people love this because they go faster. They can do more to your Jevons law piece. They are more efficient with the efficient software.
Dave VellanteTo your point, it's instructive to look at how these companies responded. NVIDIA was like, "Cool, this is innovative." IBM is saying, "Hey, this justifies Granite." AWS ans Microsoft, I think IBM as well, Dell, I think Michael Dell, they're all running DeepSeek. Look, we can run DeepSeek in Bedrock. The software vendors, like Salesforce, they're happy about it. And look at Anthropic. Anthropic said, "Oh, the US government should go after China." Because they're threatened. "OpenAI, you stole from us." Which is ironic because they were trained on the internet. But again, they have, they just said, a 300 billion valuation potentially, raising 40 billion with SoftBank. So that's why I think they're TBD. But the response from these companies has generally been, if you're on the AI curve, the response has been generally positive. And I think-
John FurrierThe conversation shifted from stock price to the future of AI, because I think the short term radius blast of this was stock price impact. So what's the competitive... And then the conversations around NVIDIA mode, this, that and the other thing. But I think the deep conversations here in Silicon Valley and in the AI community is what is the real future of AI? And what you're starting to see is some of the things we've been saying on theCUBE here all the time, which is it's a systems revolution. So you have, I call it the chip grid, emerging, which is clustered systems. Where it's not about throwing gear at problem or GPUs. It's the combination of the hardware configuration. And what they did with the chips that they had was they didn't have the big iron big chips. They used a little less capable but still good chips. And they went to the low level assembly language and tweaked it.
Now that's clever, and good hack if you will, but it was the software side that grew it. So what they showed was is that efficiency beats spending. And if you look beyond the current landscape, the AI models that are continuing to grow in complexity, size, specialty models. And this fusion of models, which we've been predicting, by the way on theCUBE, I've been saying this since cows were coming home, models will interact. And what they're proving is their distillation with OpenAI and the existing models was they essentially sucked out the value like a child from the parent, the information and learned at the lower cost. That's software. Now, if you're going to do this at scale, you can buy all kinds of new chips. Remember we had the conversation with Charlie Kawwas at Broadcom, it's what's around the chips that matter.
The chips. So a grid configuration like this is off-the-shelf chips, FPG&A. This is kind of where the infrastructure is going. So it's not about just getting an NVIDIA GPU, it's GPU plus memory plus all this other stuff around it, open-standard Ethernet or whatever that is. And then the software to run it. To me, this is, I think, a big aha moment. And threatens things like, I'm going to say it, CUDA. CUDA <inaudible>. Can CUDA be replicated in open source.
Dave VellanteThat's what everybody's saying. That's what this guy, Jeffrey Emanuel said. He said, again, same arguments. But that's not a new argument. Maybe this is, like you say, a wake-up call that says, "Hey, the art of the possible." But we'll see.
John FurrierIBM made custom their own silicon for the mainframes and mini computers. And then Intel had the small little chip. Intel started out making memory from the spin out of their Fairchild.
Dave VellanteYou know I remember.
John FurrierAnd then, "Oh, this little chip." And then there was other chips. And then the PC was essentially just a combination of off-the-shelf chips that made a computer work. Now granted, it was elementary. Everyone's watched the history of Apple, whether you read the books or watched the movies. They're in the garage and they put together a motherboard and shipped a wooden PC box, basically. The first prototype. To me, this is a largest scale version of that where they actually did the innovative configuration that brought in the software. Again, the two levers, hardware and software. And again, that's a big story and all the training costs and reasoning. I think there'll be leapfrogs, Dave, on that. I mean you're seeing the leaderboard on change almost every day. It's like watching the horse race in the lead. This one comes back, balls ahead. I think you see a lot more of that leapfrogging.
Dave VellanteIt could be different this time around. But the history of silicon, you mentioned IBM. IBM was the dominant silicon player. They had the best price performance, they had the volume. This is back in the mainframe, so the volume wasn't that high. But they dominated and then they handed, to your point, the monopoly to Intel because they said, "Oh, let's outsource because these are little toys. Let's outsource the microprocessor." What happened? Volume and value. And Intel became a monopoly and had monopoly power. And I believe that NVIDIA has a similar dynamic in this business, and it's even more powerful because of its software advantage. And again, I think it's about value and volume. Now, the difference this time around is open source wasn't there to disintermediate Microsoft.
It eventually did, by the way. I have always argued that Linux is what really unseated Microsoft's dominance when Microsoft went sideways for 10 years before Satya came in and transformed the company with Azure and the cloud, and all these wonderful acquisitions. So that's the wild card now, but I still feel that NVIDIA has that advantage. And I think it's much more than just CUDA. I think we saw so much at CES around, whether it's robotics and Omniverse and these digital twins, I think the tooling and the libraries, they've got 400 AI optimized NVIDIA GPU optimized libraries, maybe open source can replicate that.
We will see. And maybe eventually will, but I'm going to come back to volume. NVIDIA's got the volume lead. You remember at your panel at the NYSE, the gentleman from AMD was saying, "Well, we have more wafer volume than NVIDIA. And I talked to him afterwards. Of course, and said, "Well, you don't in AI." He goes, "Oh, that's true." But so great. You got more x86 volume. That doesn't do you any good in the world shifting from x86 to AI and highly parallel processing. I'll say this, NVIDIA is getting hurt. It's not investment advice, it's just my opinion. I think this is a buying opportunity for NVIDIA maybe to go down more from here. But I think NVIDIA is going to continue to have really, really strong quarters. And at one point people are going to go, "Wow!" when they announce their earnings, and the stock's going to be back and they'll start running again.
John FurrierI agree with you. Well first of all, I don't think this is going to have a material impact. In the short term it will with the news, because we got sold the story that this low-cost, high-performance AI system's really going to take out NVIDIA. I think that was just a false story. I think everyone in that chip and systems business will thrive. I think this will mostly tip the scales on the software side and the app developers. It's going to really create a boost for what I call these AI labs and AI platform builders, the systems builders, who are going to roll out AI factories and AI refineries inside companies, whether that's in the cloud or on-prem, both win. Cloud and on-prem win. And then ultimately the edge, whether you're a retail outlet, smaller devices with computer vision, whatever, they're all going to get smarter instantly. I think the software key piece is huge. So again, I am very bullish on the sector of the picks and shovels. In this case, it's the platforms, the tool.
Dave VellanteI like Broadcom too, John. I like Broadcom. What they're doing with Meta, these CapEx spenders. Google and Meta, they're not going to stop spending.
John FurrierI use the word chip <inaudible>, because I couldn't think of a better word, and Broadcom is the poster child of this. You look at how they're doing their business, when they showed us at their financial analyst meeting what they're doing with the chips, they're getting bigger. Cerebras has got the biggest chip, love that company. But it's what's around them. So it's the design of chips to chip communication. And this is what DeepSeek did to innovate, because they had no better gear. They liked the Steve Jobs and Wozniak in the garage. They had to put together some hardware to make their software work better. And it worked. So that's why I think the bigger folks are already responding. You look at all the major chip people, they're responding. We can run it on ours. We're faster. I think it's going to be good for them. I don't think they're going to get hurt. And by the way, NVIDIA is selling more GPUs to DeepSeek than everybody else. So they're the arms dealers.
So they're going to win Broadcom, NVIDIA, Cerebras. These are the companies that will take advantage of, again, the software innovation. They just get better too. Faster, smaller, cheaper, as Intel used to always say. So look, that's key. Now I want to get your take on the other piece because while they were selling us this story and why it came out as a low cost, low power high performance system, the deeper implications, Dave, is the rise of the geopolitical balance of power on AI. The elephant in the room is China. Is this a big conspiracy theory? Is DeepSeek part of a Chinese psychological operations, psych ops? A lot of people going there, talking there. What is your take? I have an opinion on this, but I want to get yours first.
Dave VellanteWell, I do think that the Chinese government, this is what I believe, that the CCP was in cahoots with DeepSeek and provided resources. I don't think we know the full story. I put out a tweet, I'm sure everybody's seen it by now, but it was something on Reddit where people were typing in what's the story behind the image of the young man in front of a tank? And then it started to answer, you saw this, right?
John FurrierYeah.
Dave VellanteAnd then it was wiped out. Oh, I'm not allowed to answer that question. Okay. So that was interesting. And I do think they had access to some advanced silicon. I think from a public policy standpoint, when you go back to the AI technology diffusion legislation or policy that the Biden administration put out just at the end of his tenure, we talked about this quite a bit, but China, no chips for you. Any company that's an enemy, I think that it gets solidified by Trump. I think the opportunity is that big fat tier two middle. I hope it's not a big regulatory capture for the hyperscalers. I hope that they open up that middle and entice people.
I hope they compress that tier two into two tiers. They should put them either in tier one or tier three. Either you're with us or you're against us. And the more people that are with us that we can trust, the better. And that's how I think you beat China with a broader ecosystem.
John FurrierIs it their psych ops on us? What do you think?
Dave VellanteYeah, I definitely think there's a Bouncing Betty involved here, as you say. There's no question about it.
John FurrierTo me, I definitely think it's a psychological operation. And because look what happened. Trump did the TikTok, we all know what's going on. What you mentioned, some of those restrictions, which as I was saying earlier, is a blessing in disguise for them. Our export restrictions actually gave them the ability to innovate. Just like Steve Jobs couldn't get chips, he got his hands on some, made a PC. So this is kind of happening here. But the mounting evidence that if you squint through the innovation and the hype around the training numbers, is DeepSeek has ties to the CCP. Okay? The founders got close connections. It's the High-Flyer hedge fund, probably was shorting the stock. I guarantee you there's no way to track it, but they probably have made more money there. They had access to government resources, political influence and strategic alignment to China's broader ambitions. See, that's clear. That evidence is there.
Two, the stock market disruption, the way they launched, the way that went down, I've seen many stock product launches and game changers that sandbag the press, got everyone excited, everyone got hit. If you look at the trillion dollars in market cap that was lost, okay, all those vendors, NVIDIA, Microsoft, Meta, all lost trillions of dollars. That was a disruption that hits mainstream America. Okay. That's a nice little paper cut right there. And then the censorship and control, you mentioned the tank at Tiananmen Square, they're self-censoring topics. So again, although they open source, as I said earlier, I don't think this was the salvo strike to end all other strikes. I think this was the one flurry of many to come. And I think they're flexing and I think there's a lot more behind it.
Dave VellanteYou're right.
John FurrierSo to me, I think this is for us to pay attention in the US and saying, are we going to have a Cold War or are we're going to have a collaboration? So this is going to be very interesting to watch. I remember I said in the pod, the AI is like the Manhattan Project. Remember that drove a lot of innovation, certainly atomic bomb. That was bad. But that was a wartime thing. And a lot of the debate here in Silicon Valley was around, no, a Manhattan Project is self-serving to the US, but a more global collaborative is better for the world. Those are two different mutually exclusive scenarios. You can't have a Manhattan Project and an open source global innovation. You just can't. It's impossible. So what this is strategically for China is burn the village down, knock a few punches down to OpenAI and the leaders like the CapEx spenders. That takes them to the mat. That's a punch that knocks them down, kick the stock market, get some disruption there and start setting the agenda for the open global that counteracts the restrictions.
And then that's just the first salvo. So I think this is going to be interesting. This is going to be an AI Cold War era between the US and China and their triumph. Impressive with the breakthrough, but I think there's a strategic bigger game going on in the geopolitical. And David Sacks talks about this. You almost see the way he's talking. He's a hawk, right? So we'll see how that goes. That's my perspective based on what I'm seeing and reading the tea leaves. Geopolitical and this chip grid is interesting because everything you said, it's all going to come into it. Who's building the systems? Where's the supremacy? Is that a competitive advantage? Is that going to be a resource? And that's just my perspective.
Dave VellanteIf you want to screw with the US, one of the best ways to screw with the US is to screw with the stock market.
John FurrierExactly.
Dave VellanteOkay. Now the other way is if you can attack critical infrastructure, but that's an act of war. Whereas this, the CCP has plausible deniability. And it's just-
John FurrierIf the chips take the models, it's like a malware sitting in there. It's a zombie waiting to be turned on. A lot of people don't trust this. Now, I'm not saying that's a zombie, I'm just saying the scenario would be let's get the chips, let's change the games, and one, make it global. But let's infiltrate the systems level. Remember we said all the alpha developers are all going down to the hardware level. They did that here, assembler. They changed the chip configuration, the way they talk to each other, at an assembler level. That's coding at the machine level. We've been saying that on theCUBE ever since we started talking <inaudible> year ago.
Dave VellanteLoad to register, load a story.
John FurrierYeah, this is an old school assembler. I'm dating myself, but you had to be proficient in assembler when I got my CS degree in the '80s. Here, this is where the war will be fought. Low level coding. So software supply chain, what does that look like when you're distilling across models? Here's an example. Say we have a proprietary model and we distill with the China model. We don't know what's distilling between the two. If they're working together, I got to verify that endpoint. So this is opening up a whole nother level. And I think the psych op is, again, one salvo, one flurry, throw a haymaker, disrupt the stock market, rattle the cage, knock down the big players, weave in censorship. That's the conspiracy theory right there. It's a dark place, I know. But you go there, you go there.
Dave VellanteI like it. I think you have to be open to the possibility. The probability is north of zero, that this is a PSYOPs initiative from the CCP.
John FurrierAll right, let's get back to the positive. Okay, Dave, this is great innovation. Who wins? What's the upside here? So to me, now the positive side of me, and I leave the dark side, come back to the Jedi side, developers win. This is seeing the results in the market when you look at people who are doing the analysis. Developers win here, you get powerful, specialized tools to build applications on. It's cheaper to run. It runs on better hardware. The hardware gets better. So I think larger models that have the ability for small models to integrate into, with diffusion, could lead to cost-effective specialty models. This absolutely changes the power curve that we drew two years ago and supports our thesis that there's a long tail and then the neck and torso are going to fill up with capabilities. Still have the big whales up there, whether they're proprietary or open. The big models will be there.
So the efficiencies will come in large scale resources and establishing new models, more and more coming every day. So that's number two. Three domain specific AI. So that's what's hot right now with these small language models is if you earn the enterprise, if you have domain expertise, that's where all the innovation is. That's where all the value and ROI is coming. So all the enterprises have a hurdle for all the new gen AI. If you can't show value, you mentioned it earlier, you're out. So to me, that is huge. So as you get cheaper models, you can run them with domain experts. That's going to open up agents. I think that's the positive implications of this. And it's going to make smart training happen cheaper. We could probably train theCUBE AI with this. So this is an efficiency game on the software side. It's a gift to developers basically <inaudible>.
Dave VellanteYeah, and like I said, I think the market wins overall. I think anybody who wants to apply AI, which is everybody, wins if there are new lower cost ways of going down the power law. That power law is, to me, it was validated even further this past week. Along with I think edge computing, one of my predictions last week in Breaking Analysis was edge computing is going to show meaningful revenue in 2025. And I think this, again, this just democratizes the adoption of AI and extends it. And I think you ain't seen nothing yet. I think this is going to just explode beyond. NVIDIA is getting hit. It's below 3 trillion now. Is it Cisco in '99 or does it have legs? And I think it's the latter.
John FurrierI think Dave, the AI efficiency with the domain experts of three things I mentioned. AI was dominated by the large players, large organization with vast resources. That led to the leaders being at the head of the long tail that produced the state of models. With DeepSeek, that flips it up on its head. Because now if you have domain expertise in a very narrow area, you can build efficient models cheaply without buying huge compute infrastructure because the reasoning and the precision the way they did it, that's going to allow people to do cogeneration, financing modeling, medical modeling, legal analysis. Every vertical now doesn't have to buy into the large costs. But they still will need to use some of the bigger models. This doesn't make the big models go away. It just allows for, as you said, democratization, which means, hey, an organization can build their own model, put it on a server, on prem.
Again, that's why I think the Dells of the world are going to win because it opens up massive possibilities. And I think that'll create better software. And then those hurdles in the enterprise, like resilience and security will ultimately be met. Right now they're stuck. There's nothing happening in the AI enterprise because the hurdle to get approved is going through the airport at TSA. "Go back again. Take your shoes off."
Dave VellanteBy the way, did you see the former Microsoft engineer who put out the video with that Tiananmen Square prompt? He downloaded DeepSeek, put it on his own cluster in his basement and put the prompt into DeepSeek and, oh, he got an answer.
John FurrierYeah, yeah.
Dave VellanteThat was a pretty good demo.
John FurrierThey're also, China's throttling YouTube to us, so that in the news as well. <inaudible>.
Dave VellanteYeah. Tit-for-tat.
John FurrierYeah, so that's pretty much Dave, what's going on? I think that's the deep dive. And in summary, to me it's like, let's watch this, but the ripples are clear. When my phone was ringing off the hook, my relatives were calling me, "Hey, what's this DeepSeek thing?" First it was Stargate the week before, now it's DeepSeek. I think TikTok shut off. DeepSeek... No, Stargate and DeepSeek back-to-back fodder for us on theCUBE Pod.
Dave VellanteYeah, and to your point, I think the timing was not a coincidence. And did you notice Alibaba came out with something? It didn't get as much news. It was second. Like Jensen says, "You want to be first." Alibaba came out with, "Oh, our model is actually faster." But nobody paid attention. But people should pay attention. Because to your point, there's going to be a lot more of this over the next year or so. Yeah, look at it. Do we mind competition? Are we afraid of competition in the United States? I hope not.
John FurrierOpenAI's got a wake-up call. I see a report here from Wired Magazine. DeepSeek has galvanized OpenAI staff who feel OpenAI must become more efficient or risk falling behind its newest competitor. So look at it, just another horse on the track, but I love them action. Here is multiple threads, efficiency, software innovation, psych ops, global geopolitical Cold War race. I mean this is all very interesting. Very, very interesting. We'll keep track of it. Yeah. So next week I'll see you in New York. I don't know if you've seen the calendar day, but the events are popping big time this year.
Dave VellanteI have seen the calendar and I got a little nervous.
John FurrierThere it is. I would say that this is probably the first year since COVID that events are more than I've ever seen leading up to around 2018, I think would be the height of the event season in terms of tech companies. I think we're back at that level, Dave. May, I think we're on the road every week in May.
Dave VellanteYeah.
John FurrierAnd April's filling up. June's got even a ton of events. So April, May, and June, tons of activity. The events are back. So of course with the studio in Palo Alto, Boston and New York.
Dave VellanteYeah. Thank goodness we have more people on the team this year with the analysts that also can really hang in theCUBE. And so I'm looking forward to being in Las Vegas a hundred days this year again.
John FurrierI am. Check out inference.cerebras.ai. That's their new R1 and it's fast. It's really, really fast. I was playing with that. So that was cool. All right, Dave, great to chat.
Dave VellanteYeah, we'll see you next week.
John FurrierDM us and tweet us if you have comments on what we said and have input. We're still tracking everything. There's so much more commentary. I got a file on DeepSeek that's miles long watching CEOs weigh in. And just overall, content's great. So thanks for-
Dave VellanteInteresting, right? Every CEO has weighed in. What does that tell you?
John FurrierYeah, it's fashion man. It's the new fashion. Hey, we'll see you later.
Dave VellanteThanks John. We'll see you around.
John FurrierSee you next time.
Dave VellanteThanks everybody.