Your IgG is the one to pay attention to here. The IgM is totally unreliable, and shouldn't be done on adults. If you are thinking this is an older infection, the IgM is useless anyway, as that only looks for newer infections.
My IgM was negative when it should have been positive, and pos when it should have been neg.
You can read more about it in the Herpes Handbook - https://westoverheights.com/herpes/the-updated-herpes-handbook/ (It's free, and written by Terri Warren, who is one of the world's leading experts in herpes.) The IgM info starts on page 13.
The majority of people with herpes don't get symptoms. 90% of people with hsv2 don't know they have it because their symptoms are so mild they'd never attribute it to herpes, or because they don't get symptoms.
Read through the handbook - it has tons of good info other than testing - and let us know if you have any questions.