undefined | Better HN

0 pointsg15jv2dp1y ago0 comments

This assumes that you can sell 100% of the resources' availability 100% of the time. Whenever you have more capacity that you can sell, there's no opportunity cost in using it yourself.

0 comments

3 comments · 2 top-level

michaelt1y ago· 1 in thread

A few months back, a lot of the most powerful GPU instances on GCP seemed to be sold out 24/7.

I suppose it's possible Google's own infrastructure is partitioned from GCP infrastructure, so they have a bunch of idle GPUs even while their cloud division can sell every H100 and A100 they can get their hands on?

dmurray1y ago

I'd expect they have both: dedicated machines that they usually use and are sometimes idle, but also the ability to run a job on GCP if it makes sense.

(I doubt it's the other way round, that the Deepmind researchers could come in one day and find all their GPUs are being used by some cloud customer).

myworkinisgood1y ago

As someone who worked for an compute time provider, I can tell you that the last people who can use the system for free are internal people. Because external people bring in cash revenue while internal people just bring in potential future revenue.

j / k navigate · click thread line to collapse