undefined | Better HN

0 pointshtrp2y ago0 comments

Do they really? As far as I can tell, diffusers/transformer are open sourced wrappers around torch implementations, there are a bunch of companies that are offering inference (just like they are), and there is some value in offering S3 storage to allow for model search.

If they reach a point where they actively become community-hostile, someone will just fork their codebase and release a web app called "FaceHugger"

0 comments

13 comments · 2 top-level

jeroenhd2y ago· 11 in thread

Their Git LFS based hosting is used by a lot of AI tools. Huggingface level data storage and transfer would also be VERY costly to accomplish for a small party. Some of these models are several gigabytes in size and downloaded hundreds or thousands of time per day.

What they do isn't too hard to replicate, but the price for which they do it is impossible to compete with.

lsmeducation2y ago

Lol, I’m sorry what? Has anyone heard of BitTorrent or piracy in general? You’re telling me AI models/data are too big?

Someone utilize p2p for the love of god. Pretty sure there’s gigabytes of porn moving (freely) through the internet millions of times per day.

jeroenhd2y ago

Some models are distributed P2P. They download slower, in my experience, and require special software rather than the usual git commands.

P2P model distribution isn't impossible, but it's a lot less interesting to many people, or they would've already spread their models through torrents in the first place.

1 more reply

esafak2y ago

GitTorrent came and went.

brucethemoose22y ago

CivitAI has somehow managed this over in Stable Diffusion land.

In fact, I think the whole community is HF averse. The two most popular frameworks are based around the Stability implemenetaion and file format, not HF diffusers.

osanseviero2y ago

FYI the file format, safetensors, was proposed, developed and maintained by HF, and involved people from groups such as Eleuther and Stability for external security audits.

https://github.com/huggingface/safetensors https://huggingface.co/blog/safetensors-security-audit

version_five2y ago

Any sense of why they are HF averse?

3 more replies

dharmab2y ago

Is that so different than some free to play video games? Those are sometimes hundreds of GB and downloaded by millions.

coffeebeqn2y ago

They come with a finely tuned monetization system built in and are very profitable

htrpOP2y ago

If Amazon/Google/Microsoft wanted to own that space, they could do it in a heartbeat.

Rumor has it Github is actively working on something similar to HF Hub already

forgingahead2y ago

I've seen some repos on Github host the models on "Releases". Not sure how viable that is long term, but definitely easier to download and access than some random Google Drive link which is typical for a lot of other repos.

mistrial92y ago

agile ; community-minded ; efficient

pick one if you are lucky. Those Fortune-12 giants can't do anything "in a heartbeat" .. listen to what that means.. nonsense

version_five2y ago

They have this "accelerate" framework they push too: https://huggingface.co/docs/accelerate/index

I don't know much about it, and I think (but couldn't quickly confirm) it's open source, so your point about a fork still stands, although I don't think that solves everything. If it did, people wouldn't care that e.g. Hashicorp changed their license away from open source.

j / k navigate · click thread line to collapse

0 comments

13 comments · 2 top-level

jeroenhd2y ago· 11 in thread

What they do isn't too hard to replicate, but the price for which they do it is impossible to compete with.

lsmeducation2y ago

Lol, I’m sorry what? Has anyone heard of BitTorrent or piracy in general? You’re telling me AI models/data are too big?

Someone utilize p2p for the love of god. Pretty sure there’s gigabytes of porn moving (freely) through the internet millions of times per day.

jeroenhd2y ago

Some models are distributed P2P. They download slower, in my experience, and require special software rather than the usual git commands.

P2P model distribution isn't impossible, but it's a lot less interesting to many people, or they would've already spread their models through torrents in the first place.

1 more reply

esafak2y ago

GitTorrent came and went.

brucethemoose22y ago

CivitAI has somehow managed this over in Stable Diffusion land.

In fact, I think the whole community is HF averse. The two most popular frameworks are based around the Stability implemenetaion and file format, not HF diffusers.

osanseviero2y ago

FYI the file format, safetensors, was proposed, developed and maintained by HF, and involved people from groups such as Eleuther and Stability for external security audits.

https://github.com/huggingface/safetensors https://huggingface.co/blog/safetensors-security-audit

version_five2y ago

Any sense of why they are HF averse?

3 more replies

dharmab2y ago

Is that so different than some free to play video games? Those are sometimes hundreds of GB and downloaded by millions.

coffeebeqn2y ago

They come with a finely tuned monetization system built in and are very profitable

htrpOP2y ago

If Amazon/Google/Microsoft wanted to own that space, they could do it in a heartbeat.

Rumor has it Github is actively working on something similar to HF Hub already

forgingahead2y ago

mistrial92y ago

agile ; community-minded ; efficient

pick one if you are lucky. Those Fortune-12 giants can't do anything "in a heartbeat" .. listen to what that means.. nonsense

version_five2y ago

They have this "accelerate" framework they push too: https://huggingface.co/docs/accelerate/index

j / k navigate · click thread line to collapse