While the recent IRS disclosures of targeting Tea Party activists is deplorable, I'm still optimistic that it's the exception and not the rule in the US.
Criminals gaining this access is definitely plausible.
Foreign governments using it for oppression/retaliation is also very plausible.