Maybe we should just directly delegate voting to experts? Or are you saying that you can't trust any organization to evaluate political candidates and programs? That can't be true. We delegate all kinds of judgements, many more important than voting to experts, for good reason.
In what way is it a sleight of hand? I'd argue that most people delegate almost the entirety of their voting decision to some external authority, in almost exactly the same way as they'd sign up for and use a service like NewsGuard.