You can phrase it that way. But it's a deceptive statement. For the most part, people don't switch parties they vote for. They just choose not to vote instead. So taken in aggregate, you could say "we disliked Hillary so we voted for someone worse".

But the more accurate statement is that some groups of people decided not to vote at all because they disliked Hillary, and other groups of people decided to show up and vote.