You indeed can't average a bunch of viewpoints and get anything good out of it. That's why Alan Kay usually has that vector space example where "different viewpoint" means giving yourself a vector out of the existing "plane of viewpoints".