undefined | Better HN

0 pointswintermute91243y ago0 comments

I have never seen this tool. Thanks for sharing!

The Alibaba price you cited is for interruptible/spot. For V100 on-demand (uninterruptible) Oracle is least expensive from that list at $1.275/hr.

0 comments

5 comments · 1 top-level

freediver3y ago· 4 in thread

Thanks, I created this tool to exactly find cheapest GPUs then expanded to everything else.

Interruptible is sufficient for model training which is what these high end GPUs are typically used for (and you want cheapest possible)

jonathanlei3y ago

Wow, cool! Yes - interruptible can be very cheap... I'll add it to our backlog so we do that instead of idly mining

I was wondering, do you happen to have an API for listing servers? We're launching a marketplace later in August (https://www.tensordock.com/product-marketplace), and we expect pricing to be really really cheap. Like #1 in industry cheap while retaining.

Interruptible, if we add that, would probably be even less than those prices listed.

It'd be really cool if we could auto-update availabilities of GPU servers through an API so that we can list our servers on your tool as well :)

freediver3y ago

If your prices really end up being industry cheapest let me know and we can make it happen.

wintermute9124OP3y ago

Didn't realize you made this tool. It's super useful.

Some unsolicited feedback, if you're still actively developing:

- You should consider some of the lesser known cloud providers (e.g. Coreweave/Lambda Labs/TensorDock).

- Add information about whether the servers support NVLink/NVswitch. For example, A100s come in 3 flavors: PCIe without NVLink bridges, PCIe with NVLink bridges, and SXM with NVlink/NVSwitch fabric.

freediver3y ago

There are hundreds of smaller providers, each having a different API , if having it at all, so this is not possible for a one man operation. CloudOptimizer is already the largest cloud comparison tool on the web (12 cloud providers listed)

j / k navigate · click thread line to collapse