Bitcoin didn't go 5x just because of him. It was already on an upward trajectory, breaking new all-time-highs, and around 30k, if I remember correctly, when he made the announcement that Tesla bought bitcoin and is accepting it.
It did jump up 6% the day he announced Tesla was accepting bitcoin, but he effectively undid all of that (and more, it went down around 12%) yesterday, as well as add more seeming legitimacy to the 'bitcoin is bad for the environment' line that the media has been pushing hard since it started shooting up again (they didn't give a shit when its price was low, even though not much has changed for energy use between then and now).
Some people aren't just looking to make a quick buck, they want to see crypto become a more stable asset class, not just another pump and dump scheme (plenty of shitty alt-coins for pump and dump schemes). This one tweet put a lot more uncertainty into that (it shouldn't have, but it did), especially if it triggers a wave of 'well bitcoin is bad for the environment, so we better get out' from other entities.
Also how would he not know bitcoin's energy usage before the first announcement? If he had done any due diligence at all he would have known this, so either they didn't do any research or it's a bullshit scapegoat to cover up the real reason they're backing out.
In the long run I think Bitcoin will survive this, but in the short term it could prematurely kill (or at least significantly stunt) this current bull run and we could already be back on track for the next multi-year bear market, which I've been through twice now with bitcoin, and it sucks (good for accumulating bitcoin on the cheap though).