If that were the case then you could get into orbit by simply going straight up. Why do they go laterally up to 8km/s then? (if not to generate an 'outward' force?).
There are two vectors being added here. One is gravity. The other is a tangental/outward vector. When added together, they form an orbit. Ignore one, and you leave orbit, either by going into space, or smashing into earth. But there are clearly two forces/vectors. And one of them, is having it's direction changed by the other, and thus is acceleration... I don't know what other words I can use to describe it. But I fail to see where I'm wrong :\