August 16 would be the due date the doctor would have given you if you got pregnant on November 23. Even if the sperm lived the usual length of time in your body (assuming some got out of the condom, which doesn't sound like happened), the latest due date the doctor would have given you from the sex on November 23 would be around August 22 or so. You were given the due date of September 7 by a doctor looking at the actual baby and its developmental markers in an early ultrasound. I would try not to worry, it all sounds like your husband's child.
Hi, how did you get your due date of September 7? Was it from an ultrasound early in the pregnancy? If your due date is accurate (from a doctor measuring the baby as seen on an ultrasound in your early pregnancy, before 8 weeks) it sounds like you conceived around December 15. Do you ordinarily have irregular or long menstrual cycles, sometimes going for weeks without a period?