> introduces latency and makes it difficult to implement modern features like smooth animations,

Move X [Wayland] into kernel space [provided stability isn't a concern].

It's easy to type that out, of course.