This is the biggest problem. People are losing faith in the restrictions and are starting to believe into various conspiracy theories. Most of this is due to inability to distinguish between accurate and false information.
Another problem is that CDC and other agencies at first were openly lying and trying to downplay the virus or say how masks were not effective. This leads to people not trusting what they say because everyone can remember how they were against masks and now are in favor of masks. Then you add in politicians with mixed messages and you get highly doubtful public.
IFR is around 1% in the western world. That is incredibly high for something that could become as seasonal as flu.