Like I said; that 4hr workweek was like 10 years ago: since then the week is full again. But with multiple businesses (check my profile/linkedin). We hike a lot (few hours a day). When we worked less than a day we travelled through europe, now all over the world. We try to stay longer in one place when we can, but business meetings take us all over. No kids, consciously not ever.
I would not do a lot different but as you ask; I would have started real business networking far sooner. I am a tech guy and always surrounded myself with business guys so I would not have to. I think that was not so smart. I always thought I would be bad at it, but it just is not very hard. And with the right contacts, you can grow and achieve things much faster.