The early universe was a dusty place, and the UV radiation from the hot, young black holes and stars would get enshrouded by dust, re-radiated, and scattered into red wavelengths like infra-red, causing these objects to remain obscured.