undefined | Better HN

0 pointsdekhn4y ago0 comments

for TPUv3 it's 2D torus, not hyper-cube, right? Not sure if TPUv4 topology is externally published, but IIRC hypercubes are basically never used any more.

0 comments

vl4y ago

I mistyped, one version is 2D torus, next is 3D torus aka hypertorus.

j / k navigate · click thread line to collapse

0 pointsdekhn4y ago0 comments

for TPUv3 it's 2D torus, not hyper-cube, right? Not sure if TPUv4 topology is externally published, but IIRC hypercubes are basically never used any more.

0 comments

vl4y ago

I mistyped, one version is 2D torus, next is 3D torus aka hypertorus.

j / k navigate · click thread line to collapse