The server time would drift by the latency from server to browser to start with.