undefined | Better HN

0 pointsbutvacuum3mo ago0 comments

Also, isn't memory a bit moot? At scale I thought that the ASICs frequently sat idle waiting for memory.

0 comments

You're doing operations on the memory once it's been transferred to gpu memory. Either shuffling it around various caches or processors or feeding it into tensor cores or other matrix operations. You don't want to be sitting idle.

j / k navigate · click thread line to collapse

0 pointsbutvacuum3mo ago0 comments

Also, isn't memory a bit moot? At scale I thought that the ASICs frequently sat idle waiting for memory.

0 comments

pests3mo ago

You're doing operations on the memory once it's been transferred to gpu memory. Either shuffling it around various caches or processors or feeding it into tensor cores or other matrix operations. You don't want to be sitting idle.

j / k navigate · click thread line to collapse