I disagree with Sassie. Unless you've never been kissed before, he's not the first person you've dated with it. He's just the first person who knew/told you about it.
2/3 of adults have it globally, and 90% never get symptoms. Have you ever tested for hsv1? You can ask your doctor for a type specific hsv1 IgG test to find out if you have it. If you do, you can't get it again.
If your doctor won't give you the test, or you'd rather not go there, you can go through STDCheck.com or LetsGetChecked.com and just do it yourself. They offer the same test, so choose whichever it cheaper/more convenient for you - whichever is more important.
If you don't have it, that's okay. Your partner can decide to go on daily antivirals to help reduce the risk of transmission. While we don't have transmission stats for hsv1 orally, we know that all herpes is most contagious when there are symptoms, so avoiding kissing and oral sex when symptoms are present is most important.
If he gives you oral sex, it can transmit to your genitals, and that can happen without symptoms present. Again, the risks will be lower if he takes an antiviral every day.
If you decide to not be with him, the next guy could have it and not know it, or the guy after him. If you like him, I wouldn't let this stop you. It's just way too common to let this stop you. It's your call, though.
Hello~To be on the side of safety, I wouldn't. I understand that HSV can show up at any time, so, it would be wise to play it safe.