is this the best we can do? to create better money making machines?Of course not. The best AI we could possibly create wouldn't be a paperclip optimizer. Presumably, there could be another AI who would realize and say, Let's not go to Camelot. It is a silly place.
And what will that do to our old values - stuff like kindness, family values, creativity for it's own sake?
Actually, that's also along the lines of not being a paperclip optimizer. Some people are way too obsessed with sex. There will always be others who will realize that's a bit imbalanced, and decide not to be like that. There will always be people who ask, "Is that all? Is there nothing more?" That, or we'll die out sooner than we should. In other words, if the human mind is really that bounded and limited, some problem of our own making is going to kill us off.
Or is being an Elon Musk copy will just become a requirement for working as a barista ?
Didn't being a [famous hacker here] clone become a requirement for working as a programmer in the Bay Area? Aren't there towns where all of the baristas have scripts they're working on?