I believe OP recorded him pressing a key on keyboard and counted between key is clearly pressed and the moment when xterm is up.

Compare to screen recording, this adds latency introduced by keyboard and monitor, which sometimes could be 100ms+. See https://danluu.com/input-lag/