If you live in town, it should be fine. I have well water and my dr doesn't have an issue with me drinking it, I just can't use it for mixing formula. With my son I had to use that filtered baby water. I do get the 5 gallon jugs of water to keep at the house though just because I'm picky and I don't like the taste of the water where I live.
Depends on where you live. I drink tap water but I know the water if safe.