You can say no to people who make you feel bad about yourself. To people who backstab you or make you feel anxious in any way.