Another way to see that there are no magic "dynamically selected" potrs is to run on the server "tcpdump src x.x.x.x or dst x.x.x.x" where the x.x.x.x is your client address - and check the outputs - the packets will have ports in them.
Alternatively one can read RFC793 or, better, Stevens' "TCP/IP Illustrated".