When I said I wanted to walk away from football, people think I was just talking about the two or three incidents that have happened on the pitch.