undefined | Better HN

0 pointsriku_iki2y ago0 comments

> So any 100G pizza box switches should work.

but will it be able to handle combined TB/s traffic?

0 comments

Yes. Most network switches can handle all ports at 100% utilization in both directions simultaneously.

Take for example the Mellanox SX6790 available for less than $100 on eBay. It has 36 56gbps ports. 36 * 2 * 56 = 4032gbps and it is stated to have a switching capacity of 4.032Tbps.

Edit: I guess you are asking how one would possibly sip 1TiB/s of data into a given client. You would need multiple clients spread across several switches to generate such load. Or maybe some freaky link aggregation. 10x 800gbps links for your client, plus at least 10x 800gbps links out to the servers.

bombcar2y ago

Even the bargain Mikrotik can do 1.2Tbps https://mikrotik.com/product/crs518_16xs_2xq

margalabargala2y ago

For those curious, a "bargain" on a 100gbps switch means about $1350

epistasis2y ago

On a cluster with more than $1M of NVMe disks, that does actually seem like a bargain.

(Note that the linked MikroTik switch only has 100gbe on a few ports, and wouldn't really classify as a full 100gbe switch to most people)

1 more reply

Palomides2y ago

there's usually some used dx010 (32x100gbe) on ebay for less than $500

the cheapest new 100gbe switch I know of is the mikrotik CRS504-4XQ-IN (4x100gbe, around $650)

riku_ikiOP2y ago

TB != Tb..

baq2y ago

any switch which can't handle full load on all ports isn't worthy of the name 'switch', it's more like 'toy network appliance'

birdman31312y ago

I will forever be scarred by the "Gigabit" switches of old that were 2 gigabit ports and 22 100mb ports. Coworker bought it missing the nuance.

bombcar2y ago

Still happens, gotta see if the top speed mentioned is an uplink or normal ports.

j / k navigate · click thread line to collapse

0 comments

aaronax2y ago

Yes. Most network switches can handle all ports at 100% utilization in both directions simultaneously.

Take for example the Mellanox SX6790 available for less than $100 on eBay. It has 36 56gbps ports. 36 * 2 * 56 = 4032gbps and it is stated to have a switching capacity of 4.032Tbps.

bombcar2y ago

Even the bargain Mikrotik can do 1.2Tbps https://mikrotik.com/product/crs518_16xs_2xq

margalabargala2y ago

For those curious, a "bargain" on a 100gbps switch means about $1350

epistasis2y ago

On a cluster with more than $1M of NVMe disks, that does actually seem like a bargain.

(Note that the linked MikroTik switch only has 100gbe on a few ports, and wouldn't really classify as a full 100gbe switch to most people)

1 more reply

Palomides2y ago

there's usually some used dx010 (32x100gbe) on ebay for less than $500

the cheapest new 100gbe switch I know of is the mikrotik CRS504-4XQ-IN (4x100gbe, around $650)

riku_ikiOP2y ago

TB != Tb..

baq2y ago

any switch which can't handle full load on all ports isn't worthy of the name 'switch', it's more like 'toy network appliance'

birdman31312y ago

I will forever be scarred by the "Gigabit" switches of old that were 2 gigabit ports and 22 100mb ports. Coworker bought it missing the nuance.

bombcar2y ago

Still happens, gotta see if the top speed mentioned is an uplink or normal ports.

j / k navigate · click thread line to collapse