It's not a problem when there is true and healthy competition. It is a problem when there is not and what they provide is critical infrastructure.
Either antitrust the shit out of them so there is healthy competition or regulate them so they have to allow payment for legal goods and services.