Show HN: Code to run Gemma2-2B on a Mac – a powerful model with GPT 3.5 perf (opens in new tab)

(github.com)

3 pointsnotnotrishi1y ago2 comments

I’ve used Gemma2-2B from GDM for a day, and it's a really solid model for its size from my experience. So I built a CLI app for a Mac.

2 comments

I tried to let it add punctuations to a list of words from asr, but it changes the words no matter how I tweak the prompt. lol.

lol mind sharing an example?

also in case you haven't already, can try with other models too by changing it from the code to see if they do better

j / k navigate · click thread line to collapse

(github.com)

3 pointsnotnotrishi1y ago2 comments

I’ve used Gemma2-2B from GDM for a day, and it's a really solid model for its size from my experience. So I built a CLI app for a Mac.

I tried to let it add punctuations to a list of words from asr, but it changes the words no matter how I tweak the prompt. lol.

lol mind sharing an example?

also in case you haven't already, can try with other models too by changing it from the code to see if they do better

j / k navigate · click thread line to collapse