Latency of the connection = sum of latency of every hop along the route.
So in practical terms your ISP directly controls your bandwidth, but latency is mostly out of their hands.