So, I'm getting close to 8 decades and about 5 of those watching this prostate deal. I have a few questions: You say the PSA isn't the problem, but rather unneeded biopsies because of the test? If your score has been low and then climbs to a 3, what's the next step? A biopsy is invasive and can cause issues. Sometimes, complications leading to premature death.
I've watched acquaintances treat a slightly high PSA number with removal and radiation but still succumb to death from prostate cancer.  In the meantime, there are many cases where the elevated PSA number is treated by a watch and wait strategy that sees the patient die with prostate cancer but not because of it. Warren Buffet is one example of this strategy and he is still with us.
I think some of the answer lies in the evidence that suggests that all prostate cancers are not the same. Some grow very slowly and others may be fairly benign for years, and then suddenly become very aggressive. My doc at the VA told me that there is a pretty good link to AO exposure and a very aggressive form of prostate cancer. I have seen enough cases where that appears to be true, so I won't discount the link.
Perhaps a better question might be: why is prostate cancer accepted as a pretty common side-effect of getting old? Is it possible that exercising the function of the gland may prevent problems? Many religions promote abstinence unless married. Is that healthy? If so, why?