>
Being muscular is neither a necessary or sufficient condition for being physically fit."Fit" for men is fairly muscular, because moderate amounts of physical effort by a man will result in some muscles. "Fit" for women is not muscular, because women do not put on muscle easily the way that men do.
Fit for men doesn't mean looking like a body builder, but it also doesn't mean having the same muscle mass as a woman of equal height.
> so why should lifting weights be a factor in the attractiveness of men.
Because strength is masculine. The standard for masculine attractiveness is basically unchanged for millenia. Look at ancient Greek statues. The idealized male physique is muscular and lean. This physique indicates health and athletic ability, and therefore good genetics as well as good ability to provide and protect.
> I will grant that some women do want muscular men, but I don't think it's that big a factor for most women.
Women will marry physically unfit men, and ugly men, and also mean men, and men with all kinds of other negative traits. That doesn't mean that these aren't factors in women's choices. It means that 1) you can't generalize from "some women" to "most women" just because it fits with your narrative, and 2) women can look past any factor if other factors outweigh it (men can do the same).
I'm short. I don't pretend that height isn't a factor in attractiveness to women, though. It's a huge factor, despite the fact that some (even many) women marry short men.