I do agree that ignoring the suffering you cause other people is pretty immoral, I just think most people tend to be kind of ok with that, especially in out of sight out of mind situations. Most people don’t mind if their enemies suffer, its just a balancing act of making sure that mostly it’s your enemies that you make suffer.
Not really any different than eating meat, another immoral act that almost everyone does anyway.