Personally, I don't think it's legitimate or ethical that some guy I've never met asserts the right to rule over my property because another group of people I've never met got together and voted on it.
And isn't the issue you take, in general, not with an individual "ruling over you", but with the very notion of majority rule (i.e. that "a group of people you've never met" can vote in ways that affect you/your property/etc.)?
Edit: Because I would say that the problem is the opposite: that our government is no longer an expression of the will of "the people". And my question is why isn't it?
But you asked why we are powerless to stop things like the Aaron Swartz tragedy, PATRIOT Act, etc. My answer to that is because we've all decided to cede that power to a vote.