undefined | Better HN

0 pointsrain13y ago0 comments

I don't think the integrated GPU on that supports CUDA. So you will need to use CPU mode only.

0 comments

2 comments · 1 top-level

itake3y ago· 1 in thread

Yep, but isn’t there an integrated ML chip that makes it faster than cpu? Or does llama.cpp not use that?

rain1OP3y ago

unfortunately that chip is proprietary and undocumented, it's very difficult for open source programs to make use of. I think there is some reverse engineering work being done but it's not complete.

j / k navigate · click thread line to collapse