I started up when I was 18, and ended up going to uni when I was in my mid 20s - "these people are so much younger than me!". It was a mistake (for me) not to go when I was 18.
But in your heart you know what it is you want to do. You can always change track later. Richard Branson didn't finish high school.