Much like his quote about scientific consensus. Yes, the media often sells a lie about fake consensus that doesn't actually exist, and to whatever meager extent it is, isn't supported by much evidence, but to take that (twisted, warped, and removed from context) fact and to then simply claim that one should never trust anything which has a claimed scientific consensus is idiocy.
One should absolutely be skeptical when you get a combination of factors:
1) The _only_ arguments are appeals to consensus 2) The topic has strong political valence
but those are very specific circumstances in which to be skeptical.