Yup! As Bob says, it's because of nerve damage to one eye. That's the Pulfrich effect. Perhaps your brain was shifting back and forth on which eye was focusing. I also have nerve damage in the right eye, and everything appears smaller and further away. For a year, when I looked out of that eye, closing the other one, I got dizzy and felt very weird.
Actually, it is pretty common with people that have had ON. Since signal from the unaffected eye get to the brain faster than the affected eye, it can throw off your perception of depth. My right optic never and optic tract are damaged, and thing appear smaller and farther way than from my left eye. When I look at stuff with both eyes, my brain does its best to figure stuff out, but mess up some thing (like monocular double vision in my right eye.
Bob
No never had that sounds pretty spooky.
Alex