My dad used to say, 'You wouldn't worry so much about what people thought about you if you knew how seldom they did.
or simply: