When human judgment and big data intersect there are some funny things that happen.