It's because some "ugly" features can be considered rough and masculine on men while women's features are usually supposed to be more soft and delicate to be considered attractive. Like men with overly soft features, women with "rough" features are going to have a harder time being considered as attractive by the opposite sex.
Its because women are less objetive seeking some "ideal" but rather look for something "special" or mysterios no matter if sometimes It goes far away of the beauty standards that men think women do like. Yet men are more simple in this matters and want a girl that look "hot" , a pretty face and a sexy, good shaped, proportionated body.