Color isn't so much removed as it is filtered out to improve the sensitivity in other bands. By filtering out visible light (or least, most of it) other bands can be imaged with much higher sensitivity (but it is also possible just to filter out a visible band of the spectrum for imaging).

Just like you can't see IR right now with the naked eye but you could see a BW print of an IR filtered image (that's a 'false color' image, technically that term should be reserved for images that show other wavelengths as colors that we can interpret). The same goes for UV.

A lot of astronomical imaging is done in wavelengths we can not observe directly. Almost all those 'pretty color pictures from space' are false color images.

Another important bit is that for the most part space is the same on that scale today as it is tomorrow, so if you want to make several images of the same object with different filters you usually can without much in terms of loss of opportunity. For some configurations and objects nearer to us that is more problematic but for objects further away time is on our side.

The furthest example of this is radio telescopes, which image the sky using radio waves, waves so long that they are no longer called 'light'. And yet, we can make really nice images by shifting those radio frequencies to the visible spectrum allowing us to 'see' with radio waves.