No you should not be nervous. Your new eye doctor, hopefully a ophthalmologist Eye MD, is taking proper care of you. Optic nerve drusen can make the optic nerves swollen "false" or pseuo-papilledema. So the MRI ruled out brain tumor, and brain tumors not more common in optic nerve drusen. OND can cause damage to Visual Field hense the test, and also cause thinning of nerve fiber layer hence the OCT.