Yes that's correct and there's a bit of "pixel math" as well so take these numbers with a pinch of salt. Preliminary model sizes from the temporarily public HF repository puts the full model size at 8tb or roughly 80 H100s

Yeah and can run off peak, etc.

Does seem to show an absolutely massive market for inference compute…