I disagree with your doctor. Most HSV-2 results in the very low positive range, like yours, are falsely positive. Don't blame your doctor, however. This is a common misunderstanding, and undoubtedly the laboratory reported the result to your doctor as positive.
The IgM test result is meaningless; it doesn't help one way or the other.
These issues have been discussed in great detail in the past couple of weeks. Please read the following threads for a lot of information, including additional testing that can be done to sort it out for certain. Feel free to return with one or two brief follow-up questions if you can't find what you need to know if these threads. In the meantime, you can be pretty sure you aren't infected with HSV-2. However, your positive result for HSV-1 most likely is accurate.
Best wishes-- HHH, MD