No risk at all for HIV no matter if there was blood or not.
Why aren't you more worried about the things that are easier to catch? Like meningitis or pneumonia or something? HIV is extremely easy to avoid!! Just don't ever have unprotected sex and don't share IV drugs and you will never get it, guaranteed!!
So even if there was blood on the door knob that I touched right after he left it would there be a risk of hiv exposure for me or my son?
HIV is not able to spread from a door knob. That was No Risk for HIV but there are hundreds of other bacteria and viruses that are a lot easier to catch that way that you should worry about.