It's a question of manners, and etiquette. If someone refuses to shake my hand because I'm a woman, then I owe him no respect or consideration at all.