undefined | Better HN

0 pointshelloericsf1y ago0 comments

They don't have h100. wink,wink.

0 comments

rfoo1y ago

They have H800s which have exactly same memory bandwidth and max FLOPS.

What about NVLink? Does it plays a role here?

rfoo1y ago

For FlashMLA? No. The code here runs on one GPU only and do not have a builtin communication part.

j / k navigate · click thread line to collapse

0 pointshelloericsf1y ago0 comments

They don't have h100. wink,wink.

rfoo1y ago

They have H800s which have exactly same memory bandwidth and max FLOPS.

What about NVLink? Does it plays a role here?

rfoo1y ago

For FlashMLA? No. The code here runs on one GPU only and do not have a builtin communication part.

j / k navigate · click thread line to collapse