undefined | Better HN

0 pointssillysaurusx5y ago0 comments

AI training is moving away from CUDA and toward TPUs anyway. DGX clusters can't keep up.

0 comments

3 comments · 3 top-level

And Nvidia's GPUs now include the same type of hardware that TPUs have, so there's no reason to believe that TPUs will win out over GPUs.

Where did you get this from? AFAIK GPT-3 (for example) was trained on a GPU cluster, not TPUs.

make35y ago

this is just false

j / k navigate · click thread line to collapse