undefined | Better HN

0 pointsriku_iki2y ago0 comments

12k for gpt3.

0 comments

It is not bits, but weights

So somehow ascii is less information dense than 12k 32-bit floats per token?

j / k navigate · click thread line to collapse

0 pointsriku_iki2y ago0 comments

12k for gpt3.

It is not bits, but weights

So somehow ascii is less information dense than 12k 32-bit floats per token?

j / k navigate · click thread line to collapse