undefined | Better HN

0 pointsint_19h2mo ago0 comments

That doesn't sound realistic to me. What is your breakdown on the hardware and the "top 5 best models" for this calculation?

0 comments

vntok2mo ago

Look up AMD's Strix Halo mini-PC such as GMKtec's EVO-X2. I got the one with 128GB of unified RAM (~100GB VRAM) last year for 1900€ excl. VAT; it runs like a beast especially for SOTA/near-SOTA MoE models.

j / k navigate · click thread line to collapse

0 pointsint_19h2mo ago0 comments

That doesn't sound realistic to me. What is your breakdown on the hardware and the "top 5 best models" for this calculation?

0 comments

vntok2mo ago

Look up AMD's Strix Halo mini-PC such as GMKtec's EVO-X2. I got the one with 128GB of unified RAM (~100GB VRAM) last year for 1900€ excl. VAT; it runs like a beast especially for SOTA/near-SOTA MoE models.

j / k navigate · click thread line to collapse