Having a father or a brother who has been diagnosed with prostate cancer more than doubles your chance of developing the disease. In addition, experts think that men who inherit changes to certain genes or chromosomes may be at an increased risk of developing prostate cancer. Talk with your doctor about your family history to see if you should be screened at a younger age.