If you already have oral hsv1, you have antibodies that protect you from getting it in a different place on your body, so this wouldn't be hsv1, especially from you infecting yourself.
It could easily be soap irritation or an allergic reaction to it. If you shave, maybe it's shaving irritation. It doesn't sound like herpes, but you could get it checked if you are concerned.
Are you and your bf sexually active? Are you his only partner ever? If you aren't, has he ever been tested for STDs?
It's super smart that all you usually use is water. The vagina is self-cleaning, with a really delicate balance of things that keep it all clean. You really only need to use water and maybe a washcloth to clean the exterior.
Since it's lingered for several days now, it might be wise to get it checked to make sure everything is okay. These spots might be totally normal - we have oil glands all over the vagina, and you may have noticed them because of the irritation from soap, but at least you'd know. :)
Let us know what happens.