Ask HN: Why is so many packages in LLM dev brittle?

1 pointsExorust1y ago1 comments

I've been a Software engineer for 5 years now, and recently started LLM dev.

A lot of the huggingface, accelerate and bitsandbytes are exceptionally brittle and newer models somehow get stuck in dependecy hell.

1 comments

you can probably blame pip

j / k navigate · click thread line to collapse

1 pointsExorust1y ago1 comments

I've been a Software engineer for 5 years now, and recently started LLM dev.

A lot of the huggingface, accelerate and bitsandbytes are exceptionally brittle and newer models somehow get stuck in dependecy hell.

you can probably blame pip

j / k navigate · click thread line to collapse