Wearing a hat implies that you are bald if you are a man and that your hair is dirty if you are a woman.
or simply: