I don't know maybe just be worried instead about being on the side of justice and what is right and not be so worried if that side has people you don't like on it.
I realize I'm in the minority but I side with whomever I think is right under the law, regardless of my (sometimes extreme) feelings about the parties and even about the law.