undefined | Better HN

Skip to content

Top New Best Ask Show Jobs

undefined | Better HN

0 pointsRhapso2y ago0 comments

FTR LLM embeddeds are a lot less efficient than ASCII for communication and are likely to stay that way.

0 comments

absolutely not. Transformer layers already communicate using embeddings, and ASCII would be absolutely less efficient there.

RhapsoOP2y ago

And how many bits are in an embedded vector?

12k for gpt3.

j / k navigate · click thread line to collapse