Brexit has divided the country. It has divided political parties. And it has divided families too.