I knew that if I wanted to stop being a pushover I had to get comfortable with small rejections myself. That took some work, but because of it I can now say no to other people with a clear conscience.