No need to drag a gigabyte of docker stuff into this, just extract the zip file from github and type
make into your terminal
congratulations, it now works.
If you're not a developer, maybe you'll have to type sudo apt install build-essential first. Congratulations, now you too, a non-developer, are running it locally.
https://github.com/ggerganov/llama.cpp