an interesting idea, but is the 3D really necessary? I would think a multi-stream voice / video chat in normal window type interfaces like we're used to online would be better.
Even better would be to integrate with existing voice chat apps, like voice chat in googletalk, but with support for "conference calls" in video and voice.
I just don't see this as a good idea, the implementation looks great though.