You can have both, but what kind of test did you have? Did you get an actual numerical result with it?
It takes up to a few months to develop antibodies, so at 4 days, if you were positive for hsv1, that was a pre-existing hsv1 infection. It takes a minimum of 2 weeks to develop antibodies.
Statistically, that would be an oral infection, but the blood test can only tell you that you have it, not where.
Has a doctor seen the rash?