The casual comments about appearance, gender roles and physical affection do more damage than you may realize.