undefined | Better HN

0 pointsMPSimmons3y ago0 comments

How do you deal with the 'too many tokens' problem? Like, For 13b, max tokens I've gotten it to is 508 - is there a way to increase the number it will accept?

0 comments

1 comments · 1 top-level

MPSimmonsOP3y ago

Oh, I figured this out. It runs with 512 as the default context, but you can increase it with -c

j / k navigate · click thread line to collapse