I Am Not Any Kind Of Physicist, but the way I've always considered it, is that if you can travel from point A to point B in less time than the speed of light permits, then that is essentially the same as traveling back in time.
Well, yea, it literally is traveling back in time in some inertial reference frame. So far as we know, the laws of physics are identical in one frame, it's possible in ours.