I have no interest in working in the US, and they stopped caring about it with respect to visiting about 30 years ago, so I'm not bothered.
And here in Europe few people care - I've done consulting work work with defence institutions, for example.I might have a problem getting top secret clearance perhaps, though I doubt it - most countries don't consider the type of organisations I was involved with enough of a concern anymore. Now, if I were to lie about it when asked, I'm sure they'd find out and it'd be an issue.
There are certainly places I would want to be careful. The irony, though, is that politically I'd probably be seen with more suspicion in places like Cuba and China than in the US, as if these governments were to look into my political activity they'd find connections to groups they see as ideologically threatening (such as contact with Trotskyist groups like the Spartacists, which is a bigger ideological no-no). I've visited China, and did make very sure to keep my mouth firmly shut about politics for that reason.