We use CarPlay all the time, it works almost instantaneously after plugging the phone and it is always responsive. The primary beef that we have with it is that you cannot use Google Maps. Though Apple Maps is definitely many times better than the built-in navigation system.
As you say, it is probably a problem with some hardware.
