The referendum was clear: the British people voted to leave the single market and to take back control of our borders.