What should happen when you remove an existing field, remove a method already used, change its initial value, etc? You will quickly get some incorrect state by blind hot swapping, and it is not trivial to do in a mutable object graph.
Clojure (and other lisps) can do it well because their scope of changes can be really small.
Nonetheless, method hot-swap is well-defined and is implemented by OpenJDK.