The federal judiciary has been taking criticism from both parties for decades now where both sides think that the courts have abdicated their responsibilities and let Executive authority run amok.

Of course that criticism is never consistent temporally, and always depends on which party is in which office and doing the criticism.

Either way, I'm not particularly excited about leaving things up to the courts.