Obama hasn't been divisive just because his policies are so unpopular, though that's a large part of it.