I highly doubt that people employing this scheme are thinking it through though. Lets say you indeed engage with this email, not knowing its AI. Then when things are getting serious a human approaches you after all and you find out you were talking to AI all the time. Would you not be completely outraged by being fooled like this?

I think marketers underestimate that they may turn people off their brand in the long run by these tactics, because people do not like being fooled. And the more sophisticated the scheme the more outraged people are when they find out.