Hello island time,
I'm in NW Georgia, about 40 miles south of Chattanooga.
I'd recommend getting several opinions. Vanderbilt probably offers a similar program as Duke's, where you go in for an appointment and meet with a medical oncologist, urologist (surgeon) and radiation oncologist all on the same day and they all try to help you make an informed decision.
I started out thinking I'd go wherever in the world I needed to in order to get the best, but I ultimately determined there are 'stars' scattered all over the country; Atlanta, Raleigh, Nashville, etc. I had mine done at Winship Cancer Institute in Atlanta (Emory and St. Joseph's).
20 years from now I might have a different opinion, but right now I can't even imagine why someone wouldn't go the brachytherapy route, if qualified. I went with HDR myself, and while I wouldn't call it "fun" it really hasn't been all that big a deal compared to some I know who've had surgery; ie, my dad (open), two clients I've spoken to the past week (open), and some here who've had issues after the Da Vinci.
On the other hand, some have turned out really well. HDR brachytherapy isn't 100% guaranteed either I don't suppose. But, to me, the risk of ED and urinary issues seem to be less with it. I haven't had either.
My biggest problem has been hemorrhoids from the biopsy. I'd love to know how all this would feel if I wasn't dealing with that issue for the past two months.
I wish you the best, and I'd also agree with Redwing in that I might ask a few doctors what they think about you watching it closely for a while, maybe dieting, etc. to see if the PSA changes. It might be 10 years before it moves to G7 and you'd still have the same options.