undefined | Better HN

0 pointsapi3y ago0 comments

That would make the regulations fairly pointless unless you think only mega-corps will ever be able to afford the compute for these things.

Compute continues to get cheaper and cheaper. We have not hit the physics wall yet on that.

That and if someone cracks efficient distributed training in a swarm type configuration then you could train models Seti@Home style. Lots of people would be happy to leave a gaming PC on to help create open source LLMs. The data requirements might be big but I just got gigabit fiber installed in my house so that barrier is vanishing too.

0 comments

4 comments · 2 top-level

nullsense3y ago· 2 in thread

The other day someone offered up their 200x GPU crypto mining cluster to train uncensored models after the incident on HuggingFace where someone threatened to get the uploader of the uncensored models fired citing safety issues.

chasd003y ago

That’s bizarre, what is unsafe about an uncensored LLM? Or I guess the same question in a different way, how does censoring an LLM make it safe? I could see an uncensored LLM being bad PR for a company but unsafe? How?

nullsense3y ago

That individual in particular was pushing some left-wing talking points.

Though the other day Yuval Noah Harari gave a great talk on the potential threat to democracy - https://youtu.be/LWiM-LuRe6w

zamnos3y ago

Shit, vast.ai will pay you right now for access to your gaming PC's GPU

j / k navigate · click thread line to collapse