Repository owner can edit comments arbitrarily, which already allows for impersonation, although to a lesser extent.
Also, you can impersonate commits freely.
I don't think allowing full import would be a big deal, especially if the UI made it clear that the comments were imported.
