Mainly because I work with classes that are serialized both to and from JSON, rather than having Jackson annotations added much later.
I can see it now. Horrifying! I'm sorry for your troubles.
The code-first approach only works well when you're doing something self-contained. Which, an API, almost by definition, is not.