The name James Baldwin had been around the house for as long as I could remember and meant almost as much as that of Martin Luther King.