Show HN: Run Llama 3.1 8B in the browser (opens in new tab)

(app.wiz.chat)

23 pointsgulan281y ago3 comments

3 comments

3 comments · 1 top-level

gulan28OP1y ago· 2 in thread

OP here, You'd need a GPU and the latest version of chrome to run this.

Vayu1y ago

Worked on my M1 Macbook! Is there a cost on your side to hosting this type of program that you can share? Or is the computation done on the user's side?

gulan28OP1y ago

Computation's done entirely on the client side.

j / k navigate · click thread line to collapse