undefined | Better HN

0 pointsbikelang4d ago0 comments

Wow - actually pretty astonishing how fast their inference is. So fast it feels fake?

0 comments

Yeah, when you find fast inference like that it almost feels like the answer arrives before you hit return. Now imagine it running locally with no server round-trip.

j / k navigate · click thread line to collapse

0 comments

qingcharles4d ago

Yeah, when you find fast inference like that it almost feels like the answer arrives before you hit return. Now imagine it running locally with no server round-trip.

j / k navigate · click thread line to collapse