It's not polite to refuse to dress for a parly. It's an insult to your hostess. After all, correct dress is a part of good manners.