Rex Harrison could be a rather mean-spirited man, and he wasn't regarded very warmly by those who knew him.