In January 2014 I left the Department for Education and spent the next 18 months away from politics.