undefined | Better HN

0 pointsLeoPanthera2y ago0 comments

Make sure you get the prompt template set correctly, the defaults are wrong for a lot of models.

0 comments

2 comments · 1 top-level

unifer12y ago· 1 in thread

Could you explain how to do this properly ? I've been having problems with the app and am wondering if this is ehy

Look at the HuggingFace page for the model you are using. (The original page, not the page for the GGUF conversion, if necessary.) This will explain the chat format you need to use.

j / k navigate · click thread line to collapse