I think definitionally "vibe coding" means you feel out of control, in fact I would say Karpathy is deliberately trying to bring these feelings out in people.
If you are using an AI assistant with your feet on the ground, like as a coding buddy that you pair with, you're not "vibe coding"