Creating boundaries for yourself is healthy. A lot of panic attacks, in my experience, can be stopped by actually saying to somebody, 'Sorry I can't actually do this because I feel uncomfortable.'