Yes 2/3 of men have oral HSV1, so that is not unusual. If you have it too then there really was no practical risk of further infection.
If you have not been with this partner for a year, then you would not have an initial outbreak now. Swollen lymph nodes would mostly only happen in the couple of weeks after infection.
Only way to know for sure is if you get tested. If here was no noticeable sore, chances are pretty slim. Viral shedding does exist, but you would need a test to be 100% sure. There's a good chance you have it orally, and not genitally, as the majority of the population does.