There is definitely more to an interaction than someone’s appearance but the number of situations in which it’s irrelevant are quite small, much though we might pretend otherwise. Ugly people have worse lives than beautiful ones, even if we completely ignore romance because people treat them worse.
So one should work on being attractive. Some women put on makeup. Men do other things.