undefined | Better HN

0 pointscubefox2mo ago0 comments

Cerebras just uses SRAM instead of DRAM. An ASIC would instead hardwire the neural network.

0 comments

Surely it's more of a spectrum? From a CPU, to a TPU, to a chip that hardwires softmax attention but lets you store arbitrary weights, to one that hardwires the weights directly.

j / k navigate · click thread line to collapse

0 comments

joefourier2mo ago

Surely it's more of a spectrum? From a CPU, to a TPU, to a chip that hardwires softmax attention but lets you store arbitrary weights, to one that hardwires the weights directly.

j / k navigate · click thread line to collapse