1Q8 KV cache lets a 30B model fit 100K context on a 24 GB RTX 5090 (opens in new tab)(buraak.com)3bozdemir4d ago0
2Show HN: Rip.so – a graveyard for dead internet things (opens in new tab)(rip.so)187bozdemir11d ago120
3Ask HN: RedHat for Personal UseI wonder if there is a benefit of using RHEL for personal/indiviual use for computer vision/machine learning tasks? Thank you.show more26bozdemir13d ago6
