No matter how solid the source of Midi clock, the receiver has to interpolate it’s own clock from multiple midi clock messages. Those messages arrive after passing through a network with arbitrary reliability, latency, and jitter.
The instability is at the protocol level. That is why Midi timecode exists.