undefined | Better HN

0 pointscoder5432mo ago0 comments

There are issues with the chat template right now[0], so tool calling does not work reliably[1].

Every time people try to rush to judge open models on launch day... it never goes well. There are ~always bugs on launch day.

[0]: https://github.com/ggml-org/llama.cpp/pull/21326

[1]: https://github.com/ggml-org/llama.cpp/issues/21316

0 comments

2 comments · 2 top-level

stavros2mo ago

What causes these? Given how simple the LLM interface is (just completion), why don't teams make a simple, standardized template available with their model release so the inference engine can just read it and work properly? Can someone explain the difficulty with that?

1 more reply

emidoots2mo ago

was just merged

1 more reply

j / k navigate · click thread line to collapse