undefined | Better HN

0 pointscar1mo ago0 comments

Yes, they are listed on huggingface. The instruction trained models have an 'it' in their name.

https://huggingface.co/collections/unsloth/gemma-4

Edit: Sorry, I'm not sure if this is a quant, but it says 'finetuned' from the Google Gemma 4 parent snapshot. It's the same size as the UD 8-bit quant though.

0 comments

Wowfunhappy1mo ago

Only the 'it' models seem to have quants. I was really hoping to try a base model.

kristjansson1mo ago

Basic quantization is easy if you have enough RAM (not VRAM) to load the weights.

j / k navigate · click thread line to collapse

0 comments

Wowfunhappy1mo ago

Only the 'it' models seem to have quants. I was really hoping to try a base model.

kristjansson1mo ago

Basic quantization is easy if you have enough RAM (not VRAM) to load the weights.

j / k navigate · click thread line to collapse