It may not feel like it now, but you did the right thing in your 20's. Those experiences you had and the memories that go with them will last you a lifetime, and you'll only appreciate them more, the older you get. You still have plenty of time to land that fat salary, even if it doesn't seem that way at the moment. Most people I know making large salaries didn't start doing so until they were older than you are now.
I ended up with the worst of both worlds, and am working my way out of the consequences now. I didn't travel at all in my twenties and worked my a* off in a low-paying field for too long before making a change in my 30's.