Too much of the Brexit rhetoric is based on the desire to go out and re-create Empire.