undefined | Better HN

0 pointsNetMageSCW1mo ago0 comments

The Neo has enough power to do small LLM testing and pretty much anything else a bit slowly, and costs $600?

0 comments

0x4571mo ago

Neo tops at 8GB RAM. What LLM are you going to run there? Functiongemma?

It can absolutely do some ML inference on it, but not much in terms of LLMs.

Maybe, but that does not mean that the Mac Studio is not very expensive hardware even for rich first world countries.

j / k navigate · click thread line to collapse

0x4571mo ago

Neo tops at 8GB RAM. What LLM are you going to run there? Functiongemma?

It can absolutely do some ML inference on it, but not much in terms of LLMs.

Maybe, but that does not mean that the Mac Studio is not very expensive hardware even for rich first world countries.

j / k navigate · click thread line to collapse