Most people with hsv2 will have mild symptoms, or no symptoms. That said, I understand - to a point - why your doctor said that. Testing can sometimes give confusing results, and that makes things suck more.
However, if you feel the need to know - and I get it, I am a need to know person myself - you can get it yourself. There are lots of places that offer STD testing. Google STD testing and see what comes up. If you are in the US, there are a bunch. I haven't used them, but people seem to get good results from stdcheck.com.
If you are in the UK, it's really hard to get the blood test, but there may be places. Let me know if you're there.