Vicksburg lies on top of a bluff on the east side of a large tongue of land jutting out into the Mississippi.