Hi, when you say you have burning while urinating is the burning inside your urethra or does it feel its coming from somewhere else. Also if your psa is 2.1 you really need to keep an eye on this number and would advise to have another psa test in 2 months. When a person has burning while urinating but no white puss penis discharge, would not indicate an infection in the urinaly area but could be the prostate.