We can't have Harlem become one borough for the rich.