That isn't even completely true for athletics. In some sports the peak is reached at a point older than you'd think, and the decline is much slower as well. For example:

http://www.arrs.net/SA_Mara.htm