As the polarization in D.C. spreads, the people willing to come to the middle find less and less acceptance.