It is extraordinarily difficult, even in academia, to find a job that will let you do whatever you want with your time. If you are determined to spend your time following your own interests, you pretty much have to do it on your own.