11Mo·

AI infrastructure: Nvidia chips vs. Google TPU - What does this mean for $IREN, $CRWV & Co.

I've been thinking about how the chip situation is developing in the data center infrastructure plays. The current situation looks like this:


$IREN (-4,1 %) , $CRWV (-4,87 %) or also $GLXY (-11,8 %) and the others are relying entirely on Nvidia GPUs (A100/H100) to benefit from the AI boom. The rental prices for Nvidia hardware are absurdly high, but business is going really well at the moment.


But now comes the problem: Google, Amazon and the other hyperscalers are developing their own AI chips (TPU, Trainium), which are much more efficient. And this is where it gets interesting - Google doesn't sell TPUs at all. They're only available in the Google Cloud.


As long as Nvidia remains the standard, business will continue to be great for the lessors. In the long term, however, Google's strategy could become a problem because the market for freely rentable AI infrastructure is shrinking.


Somehow I'm surprised that the issue is not yet visible in the price of infrastructure plays.

3
5 Commentaires

image de profil
No matter whether NVDA or Google chips or whatever else. You first have to be able to supply the planned data centers with electricity. The situation in the West is rather poor, China has expanded almost 4 times as much as the USA and Europe this year, I doubt that exports to China will be comparable in number and unit price or that the hyperscalers will want to put chips on the shelf that may be obsolete in 2 years' time
•
1
•
Utilisateur supprimé
11Mo
Le commentaire a été supprimé
image de profil
@Supergirl The new Gemini LLM has been completely trained with TPUs, hasn't it? An LLM is not a special case after all. In principle, however, GPUs should be the all-rounder among chips
••
Utilisateur supprimé
11Mo
Le commentaire a été supprimé
image de profil
@Supergirl Then Nvidia doesn't need to worry about goggle poaching customers for the time being, or how do you assess the situation?
••
Voir une réponse de plus
Participez à la conversation