Actually if they are around $2M looks like my company can afford one. Given this is just getting started it looks promising as I’m sure future generations will be more affordable.

ServeTheHome claims "HGX A100 platforms, when they are sold as single servers are generally in the $130K-$180K even leaving a very healthy margin for OEMs/ resellers"

https://www.servethehome.com/graphcore-celebrates-a-stunning...

Not sure about the H100, but it seems to be more supply constrained (hence pricier) atm.

Now, the real question is how many HGX nodes "equals" a single CS2 node. The math here is extremely fuzzy, as the benefit to such extreme node consolidation depends on the workload, and the CS-2 takes up less space, but the HGX cluster will have more directly accessible RAM and better turnkey support for stuff since its Nvidia.

This is actually really important from my perspective. It looks like an end user can work backwards from available inference hardware, or interference budget, required speed, then figure out a viable model size. Bring their own data and then fine tune or train from scratch.

This is getting so real so fast.