undefined | Better HN

0 pointsitake2y ago0 comments

do you know if llama.cpp will work out of the box or do we need to wait for the code to be updated?

0 comments

1 comments · 1 top-level

Likely needs to be updated

Edit: Only the case for the 34B and 70B models. 7B and 13B run as-is.

You can download the GGML model already

j / k navigate · click thread line to collapse