It's never easy to vote against some of your own party.