They imagined that it would be really difficult to run the models locally, so people wouldn't bother, but with stuff like llama.c & friends it's trivial.