Leaving politics was a good thing. I was spared a miserable Tory government where I might have ended up as leader.