undefined | Better HN

0 pointsthenaturalist5mo ago0 comments

What are they gonna do with their own FAB?

Not release anything?

There'll be a good market share for comparatively "lower power/ good enough" local AI. Check out Alez Ziskind's analysis of the B50 Pro [0]. Intel has an entire line-up of cheap GPUs that perform admirably for local use cases.

This guy is building a rack on B580s and the driver update alone has pushed his rig from 30 t/s to 90 t/s. [1]

0: https://www.youtube.com/watch?v=KBbJy-jhsAA

1: https://old.reddit.com/r/LocalLLaMA/comments/1o1k5rc/new_int...

0 comments

reactordev5mo ago

Watson…

Yeah even RTX’s are limited in this space due to lack of tensor cores. It’s a race to integrate more cores and faster memory buses. My suspicion is this is more me too product announcement so they can play partner to their business opportunities and continue greasing their wheels.

j / k navigate · click thread line to collapse