undefined | Better HN

0 pointslifeinthevoid6mo ago0 comments

I run my desktop environment on the iGPU and the AI stuff on the dGPUs.

0 comments

That's a real good point!

Unfortuatenly, my CPU (5900x) doesn't have an iGPU.

The last 5 years iGPU got a bit out of trend. Now maybe they actually make a lot of sense, as there is a clear use-case which involves having dedicated GPU always in-use which is not gaming (and gaming is different, cause you don't often multi-task while gaming).

I do expect to see a surge in iGPU popularity, or maybe a software improvement to allow having a model always available without constantly hogging the VRAM.

XCSme6mo ago

PS: I thought Ollama had a way to use RAM instead of VRAM (?) to keep the model active when not in use, but in my experience that didn't solve the problem.

j / k navigate · click thread line to collapse

0 comments

XCSme6mo ago

That's a real good point!

Unfortuatenly, my CPU (5900x) doesn't have an iGPU.

I do expect to see a surge in iGPU popularity, or maybe a software improvement to allow having a model always available without constantly hogging the VRAM.

XCSme6mo ago

PS: I thought Ollama had a way to use RAM instead of VRAM (?) to keep the model active when not in use, but in my experience that didn't solve the problem.

j / k navigate · click thread line to collapse