I wouldn't be overly concerned about this harming the baby- next time if you are having a hard time breathing because of the smell of something, it's probably a good idea for your comfort level to just leave, but I'm sure your little one will be fine.
You can talk to your doctor about your concerns as well and just let them know what happened.