undefined | Better HN

0 pointsjurschreuder2mo ago0 comments

I work in AI and I'm surrounded by RTX-4090 and H100 servers but for much of the day to day AI training I use my RTX-970 in the desktop on my desk for convenience and it works just fine for most cases.

Literally 2 meters from my desk is a 2x RTX-4090 server and many times I just use my 8 year old GPU anyway so you don't need it.

0 comments

2 comments · 1 top-level

deskamess2mo ago· 1 in thread

For a long time I thought my RTX-2060 was just not capable and the other day I did a ffmpeg GPU transcode and was surprised by how well it did. So now I am thinking about putting on some of Google's new Gemma edge models (probably the smallest will work with my 6GB VRAM + 2 GB) setup. I am not a 100% sure what that 2GB is but I think it is borrowing from the system in some manner.

cwillu2mo ago

Video encoding uses dedicated silicon, it's not using the card's compute.

j / k navigate · click thread line to collapse