undefined | Better HN

0 pointsphaemon5y ago0 comments

I'm kind of surprised GPT-3 doesn't "understand" haiku. You'd think it could extrapolate the rules?

The logs are broken!, Sysadmin sweeps up the leaves, The database cried

0 comments

2 comments · 1 top-level

rictic5y ago· 1 in thread

The encoding used by GPT-2 and GPT-3 greatly obscures many of the textual properties of words. This at least partly accounts for why it has so much trouble with meter, rhyme, syllables, and some math.

More info: https://www.gwern.net/GPT-3#bpes

stochastimus5y ago

Thanks for putting that info here!

j / k navigate · click thread line to collapse