Like height the link is probably though health and generally freedom from birth defects. It's not a 1:1 correlation, but it is a positive one.
Consistent with such views, meta-analyses
(Jackson, Hunter & Hodge, 1995; Langlois et al., 2000) show that
there is a small but significantly positive correlation between
intelligence and physical attractiveness https://personal.lse.ac.uk/kanazawa/pdfs/I2011.pdf
That said, selected populations may show a negative correlation such as when more attractive people are more easily given a job etc.