Hi, only testing would confirm herpes but from what your describing dont seem herpes related. Out breaks are not all over the place. Primary sore would be at the point of contact and recurrent would be up one nerve and is side specific.
However, when a sore appears and pops it cluster to the immediate surrounding area. If your concerned have a sore swabbed and cultured to put your mind to ease.
Do you shave? If you do, then it just might be razor burn and irritation from having sex so soon after shaving, although from what you're describing it sounds like an infection of some sort. Either way if you think there might be a problem then you should talk to a doctor and get some tests done, especially if you're feeling pain in that area.