Welcome to HW. Sorry that you find yourself here, but the door is always
open.
There are additional blood and urine tests that you may want to pursue (such as a "free-PSA"), but going to a urologist for a proper DRE is a valid first step. He would be able to better evaluate whether the problem is infection, BPH, or something else.
PSA tests are getting bad press right now, but they are one of the tools to help understand if you have a problem (not just cancer).
By the time I close this I imagine there will be a few responses from those who actually type, so I'll expect that you'll have a lot to digest fairly quickly.
Some books that will be useful:
Dr. Patrick Walsh, Surviving Prostate Cancer (3rd Ed.)
Dr. Peter Scardino's Prostate Book
Ask questions as you have them - we have guys here who have done virtually every treatment path.