When the citizens of Baltimore banded together to repel the British during the War of 1812, three in five were immigrants, and one in five was black - some were free, some slaves.