The bigger problem was that very few users would have had ANSI.SYS loaded and that's out of the already small pool of users who knew that device driver could be loaded (in a hidden system file, CONFIG.SYS) or what garbled escape sequences would look like. Memory was precious, ANSI.SYS used some. In a certain sense, writing directly to screen memory was much more portable.
my brain is itching now, there was something missing from ANSI.SYS... can't quite remember, maybe it couldn't remember a cursor position and jump back to it--it couldn't read the cursor position... it's hazy, something like, as a result, to use it you had to clear the screen of what had been up before and use it in full screen mode with some redraws every now and then