the smell no, the fumes yes! You can google this very easily the fumes are very harmful. Consider getting a Shark Steam Mop or a Shark Steam cleaner and not using chemicals around you or your baby.
It always gave me a headache
Chlorine is a lethal gas and is the main ingredient in chlorine bleach. Smelling the fumes is bad for both you and the baby. I would search for a less harsh cleaning substitute. Maybe Lysol?
To much of it yes not good to be breathing that stuff in, when you clean use something with less harsh chemicals.