Utilyze measures how efficiently your GPU is doing useful work (opens in new tab)

(github.com)

45 pointsnateb20229d ago10 comments

10 comments

The readme says that unless you're using vLLM you're largely out of luck with it?

The trick we use at work is to take note of the instantenous power consumed. The more it's consuming the more compute it is doing. As far as macro indicators, I'm not sure you can do better than that, without profiling.

coherentpony7d ago

You can saturate the entire power budget on pretty much all GPUs just by moving data in and out of HBM. There is no compute needed at all to do this, and bandwidth bound workloads are extremely common in the scientific computing space.

grunder_advice7d ago

Thanks for the correction, I guess I was mistaken. I always had this mistaken belief that moving data is less energy intensive.

Waterluvian7d ago

This feels like the answer to a problem I’ve had all week.

I’ve been using PixiJS (WebGL) for an project and Chrome profiler says the GPU is in use almost 100% of every frame. And nvtop says the GPU is 35% utilized by that (well isolated) chrome tab. But it’s a single quad being rendered at 60fps on an RTX 4060, so that’s obviously misleading… I hope.

embedding-shape7d ago

> Chrome profiler says the GPU is in use almost 100% of every frame. And nvtop says the GPU is 35% utilized by that (well isolated) chrome tab

Is that a problem? That the GPU is used for 100% of the frame generation is OK, is it not? And 35% utilization sounds maybe tad high for some simple web visualization, but for a full game, sounds normal.

Maybe I misunderstand what you see as the problem here?

Waterluvian7d ago

Because it’s more like 1%. The CPU doesn’t even warm up like it does when playing Half Life 1 with VSYNC on. There’s some measurement error going on with what it considers utilized.

crthpl7d ago

are you sure it's 60 fps and not uncapped?

azalemeth6d ago

This looks fantastic, but I've got access to some very nice AMD cards. Any hope of a rocm-smi or opencl version?

bstsb6d ago

i hate this method of installation:

  iex (curl.exe -L https[://]systalyze.com/utilyze/install.ps1 | Out-String)

it gives you absolutely no insight into what you’re about to run - even worse when the README instructs you to disable Defender on the install directory!

j / k navigate · click thread line to collapse

10 comments

tdullien7d ago

The readme says that unless you're using vLLM you're largely out of luck with it?

grunder_advice7d ago

coherentpony7d ago

grunder_advice7d ago

Thanks for the correction, I guess I was mistaken. I always had this mistaken belief that moving data is less energy intensive.

Waterluvian7d ago

This feels like the answer to a problem I’ve had all week.

embedding-shape7d ago

> Chrome profiler says the GPU is in use almost 100% of every frame. And nvtop says the GPU is 35% utilized by that (well isolated) chrome tab

Maybe I misunderstand what you see as the problem here?

Waterluvian7d ago

Because it’s more like 1%. The CPU doesn’t even warm up like it does when playing Half Life 1 with VSYNC on. There’s some measurement error going on with what it considers utilized.

crthpl7d ago

are you sure it's 60 fps and not uncapped?

azalemeth6d ago

This looks fantastic, but I've got access to some very nice AMD cards. Any hope of a rocm-smi or opencl version?

bstsb6d ago

i hate this method of installation:

  iex (curl.exe -L https[://]systalyze.com/utilyze/install.ps1 | Out-String)

it gives you absolutely no insight into what you’re about to run - even worse when the README instructs you to disable Defender on the install directory!

j / k navigate · click thread line to collapse