If you think this is the worst problem we have, then you are deluded. Our self steem doesn't depend on people finding us attractive. But domestic violence and rape are a problem. Being denied body integrity. Also wage gap, less promotions, medicine not considering women in their studies, being expected to take care of all the domestic chores and care for elder and children... I could go on. The point is, you might want to listen and read, look at the data and face the ugly truth that some men have it easier at work. No, not just the ones who work 80 hours a week, also the ones who are considered better just by having certain background.
Hell, in Aita reddit you can read plenty of situations where men have it better. And about the kind of problems women face. People telling us that we are "ugly" is so low on the list that barely register.