Lots of mathematicians switch to a different subfield within their careers. And they do so by self studying, obviously.
If your compsci or physics undergrad provided you with a decent degree of mathematical maturity, it should be doable. The problem here is that compsci is still young, and there is a lot of variability. So diving into differential forms after attending a Java school sounds like a bad idea.