I experienced something similar, GetBetter. My family physician didn't notice anything on the DRE, told me everything felt normal, but referred me to a urologist since my PSA was 3.0, which was high for a 49 year old man. The urologist he sent me to did a DRE and told me he felt a "hardness" near the outer rim and told me it very well might be a tumor. I wanted a second opinion so the next urologist, who ended up doing my surgery, also felt the hardness on the DRE but told me he had done enough DREs to feel comfortable in telling me that he thought it was just a calcification, not a tumor. Long story short, I chose surgery and fortunately the pathology report showed negative margins, negative seminal vesicles and negative extraprostatic extention, and was kept at T2c.
Yes, it's a tough decision you'll have to make, and a third opinion is a good idea. I didn't get one because I felt comfortable with my surgeon and knew that he had an excellent reputation and track record. I hated not having control but I had to put my trust in him and thank God, so far, he appears to have been right. Good luck in your treatment, whatever it may be.