Jensen Huang – Nvidia GTC 2025 Keynote (opens in new tab)

AMD’s is coming up in support for things like torch and xformers. But it isn’t there yet.

If you want for AI, your best bet is a used 3090 for $700-800. The ram is more important and that card is still faster than a 4070.

Thankfully the ONNX runtime supports AMD's ROCm. The performance is nowhere close to Nvidia's TensorRT, but doing inference on an AMD GPU is doable. I haven't ran the numbers, but I wouldn't be surprised if you could get more throughput per dollar on an AMD GPU for at least some scenarios. AFAIK there aren't any great options for training though, so if you want to do anything besides running ONNX models your options are limited.

For how much? In Europe they are in stock. For 3500€. For the MSRP, I'd buy it in a heartbeat.

I’ve been trying since release with stock notifications and have barely had the chance to even try to add one to a cart.

It's probably false to say they're leaving money on the table. They'd be leaving a lot more money on the table if they allocated chips towards consumer gaming GPUs instead of maxing out the server AI/GPU compute segment. The entire gaming market constitutes like 15%-or-less of their revenue nowadays.

And Nvidia has enough mindshare that they could piss on consumers for the next 3 release cycles and still have more than half the market. I don't like it but it's reality.

My 3090 Ti appreciated in price for about 20% in 2 years (1300->1600)

nVidia GPUs have basically been an inflation hedge for the past few years lol

This is sick. Lucky I kept mine https://news.ycombinator.com/item?id=42618996

Egg production fell because of avian flu, which the US has regulatory restrictions limiting the usage of the vaccine in agriculture compared to other developed nations. Its not an intentional crisis.

NVidia decide how they allocate their wafer starts at TSMC. Consumer chips have lower margin than datacenter parts, so they almost certainly allocated comparatively little volume to consumer chips.

On the one hand, this is a great situation to be in for Nvidia in terms of overall revenue.

On the other hand, this has allowed AMD to grab market share with the RX 9000 series launch, at least in the short term. So the narrow point that Geforce is sold out is decidedly not a flex.

Literally the worst thing about Nvidia is the fact they don’t take the core product end to end serious enough.

The idea it’s hard to buy a standard Nvidia GPU in the consumer lineup is absurd.

It means “envy” in Latin and Spanish etc. Which is why the logo is an acid green evil eye. And why NVIDIA’s headquarters are two buildings named “ENdeavor” and “Voyager”.

for basic AI and inference mac studios with 512 GB of ram can be a good alternative

They're really the luckiest bastards lol. First crypto, then the "AI" craze...

CPU specs from the nVidia page above:

20 core Arm, 10 Cortex-X925 + 10 Cortex-A725 Arm

Anandtech's 2024 article about the X925 & A725 Arm cpu cores:

https://www.anandtech.com/show/21399/arm-unveils-2024-cpu-co...

I'm somewhat surprised they are not explicitly mentioning the networking capabilities. There should be two QSFP(?) ports but they don't mention if their speeds and supported protocols (possibly not just Ethernet but also infiniband, but probably not).

Could be 2x200 Gbit/s, could also be much less.

It will be better than strix halo. Even the Orin AGX GPU is better than strix halo and that is Ampere.

Ah yes, a chat bot that is consistently failing to do such advanced tasks as counting letters in words is definitely life-changing, right next to the metaverse and NFTs.

I mean it's a cool demo, but it doesn't really show anything meaningful

It looks to be the whole line with different performance. But no dates and times

> glad to hear about DGX Station

how much is it expected, my guess barely fits in 5 digits. Would be nice to have something in between Spark and Station. I.e. some desktop withing $20K.

theVerge article says the DGX Spark will cost US$3K, about the same ballpark range as the Framework desktop with the maxed out 128GB RAM option.

https://www.theverge.com/news/631957/nvidia-dgx-spark-statio...

10Gb vs 5Gb Ethernet

1 HDMI 2.1, 4 x USB TypeC vs 1 HDMI 2.1, 2 Displayport, 2 USB TypeC

I think most people (including me) were expecting 384-bit and ~400G/s. Can't believe they went with 256.