Assuming you two did not have unprotected vaginal sex, I would say the odds that you transmitted your genital infection to his genitals through oral sex is ZERO. The virus would not stay viable for very long on the surface of the skin. We're talking seconds and very few at that.
A more possible scenario is him infected on his finger, i.e. herpetic whitlow, but that is very unlikely due to the thickness of the skin on the fingers; not impossible, but very unlikely.
I am assuming you have also informed him of your genital infection, and if so, he makes his decision informed and under his own volition. If you haven't informed him, you have a moral and ethical obligation to do so before engaging in any more sexual acts with him.
Good luck.