I started out like you: college -> grad school, after I got my PhD I was already 30+ with no savings. Then I did a post doc in Switzerland...then I took a job in China. Now I've been to most of Europe and much of Asia (not S. America though, too far). Now travelling doesn't bring me much excitement, but I do enjoy a nice luxury bungalow treatment every once in a while.
I've even met some of the guys coding on beaches in Thailand or Bali, they are quite laid back and zen. I'm not sure I could do it though, I'm still very much an American (meaning, puritan/work ethic roots), and would feel uncomfortable being out of the office for too long.