TLDR:
H200-powered systems are expected to begin shipping in the second quarter of 2024.
"The introduction of H200 will lead to further performance leaps, including nearly doubling inference speed on Llama 2, a 70 billion-parameter LLM, compared to the H100. Additional performance leadership and improvements with H200 are expected with future software updates."
