So, it doesn't sound like you really have symptoms. I would not be overly worried in the absence of symptoms.
I agree with GuitarRox. Herpes symptoms wouldn't appear and disappear that quickly. My guess is that you are hyper aware of things in your genital area, and since you are paying such close attention, you are noticing normal things you wouldn't ordinarily notice.
Leave the area alone for a few days - just do your normal cleaning, and see how it goes. Constantly checking isn't helping you physically or mentally.