Not to speak badly of the surgeon, but 50 surgeries is on the low side. I like his optimism, but you only get to do this once. Have you talked with a more experienced surgeon? Not to say that I think surgery is a good or bad option, but you need to feel more secure with how you feel about
it.
As to dealing with this alone, that would be me. I have fewer collateral health issues than you, but had exactly the same concerns about RT as the primary treatment. My decision was forced by the insurance company, so all the logistics issues fell by the side of the road, as I was going to a clinic maybe 20 miles away. Having looked you up on the map, I know that even if you settled for nearest, it would be more of a challenge.