Yes, you can choose not to trade, you can even agree within a group that there will be no trading in the group. But if you coerce other to refrain from any trading they wish to engage in without hurting you, they are not free.
The fundamental axiom is that you own your own body. It follows from there that you own the output of your body. Trade is fundamentally the voluntary exchange of this output for other people's output. Preventing this exchange amounts to denying you the right to dispose of the output of your body, thus denying you ownership of it, thus denying you ownership of your body.