Eyesight isn’t the thing. Humans have a persistent mental model of the world, and of the physics that drive it. Our eyes only check in every now and then to keep our model up to date.
Our ears and sense of touch do a lot of work in walking and driving, too. Trying to narrow it all down to vision is silly.