There's also the physclogical thing that comes into play here. He's in his late fifties, has no skills. The only *family* that he has created is in the prison. Remember *shawshank redemption*? I imagine that he is very afraid of the changed world that they want to push him out into. It's easier to stick with what we are familiar with, no matter how bad it is.