Hmm, I tend to think that what one can do with some objects is an essential part of what they are.
Two-dimensional vectors can just as well be thought of as points in the plane. What sets complex numbers apart is eg that we define complex multiplication of them.
A more general example: a group is not just some set G, but that set with a binary operation satisfying certain axioms.
