People who know math understand what other mortals understand, but other mortals do not understand them. This asymmetry gives them a presumption of superior ability.