Some actions have externalities and should be subject to pigouvian taxes to internalize the externality. Few people, including libertarians, dispute this point. Once harmful externalities are properly taxed/penalized, then it is no longer harmful for individuals to pursue their own self interest.

You are also correct that signalling (e.g., growing large antlers) generates harmful externalities. Thus, we should tax signalling activities such as obtaining a college degree, wearing a suit or writing in a moleskin.