undefined | Better HN

0 pointsliuliu3y ago0 comments

The comparison table from the ts_server site looks awesome though. I wish we could generate one for llama.cpp, unfortunately too busy with other things at the moment.

0 comments

ggerganov3y ago

Hey liuliu, would love if you join the project when you find the time - your work is really inspiring!

liuliuOP3y ago

Thank you for the compliment! Definitely would love to contribute in some ways, once we have the benchmark, I have some ideas :)

j / k navigate · click thread line to collapse

0 pointsliuliu3y ago0 comments

The comparison table from the ts_server site looks awesome though. I wish we could generate one for llama.cpp, unfortunately too busy with other things at the moment.

0 comments

ggerganov3y ago

Hey liuliu, would love if you join the project when you find the time - your work is really inspiring!

liuliuOP3y ago

Thank you for the compliment! Definitely would love to contribute in some ways, once we have the benchmark, I have some ideas :)

j / k navigate · click thread line to collapse