Your Q: “Should I be concerned?”
My A: I think you should be “educated.” You are on the high side of the mean (average) for your age, which places you at a higher statistical probability of joining the group at some point in time, so I say the best patient is an educated, empowered patient.
If in the future you are diagnosed, there are some excellent books I could recommend, but for now I recommend this free, downloadable document from the American Urological Association called the “Prostate Specific Antigen Best Practice Statement: 2009 Update.”
Access it at:
http://www.auanet.org/content/guidelines-and-quality-care/clinical-guidelines/main-reports/psa09.pdf
For where it sounds like you are right now, this will quadruple your knowledge and understanding. One step at a time.