1/n times may not necessarily be whole either.
How do you explain irrational exponents this way, for example? What about complex exponents?
Indeed you can extend the special case to the continuous domain -- but then the definition is expanded as well.
I still think "multiply N times" is just a special-case, and as such, not usable as a definition -- let alone an explanation of why we can add exponents in the general case.