Even before becoming pregnant I knew I wanted a water birth not having insurance back then I did research and most midwife's will charge anywhere from 3,000 to 3,500 and that absolutely covers everything. Google local midwife and you might get lucky...
If I was going to pay out of pocket what exactly would I be paying for?
You might be able to find a midwife in your area that is covered by your insurance if not the cost is not to bad if you're willing to pay for what you really want. Or look into a birthing center in your area. Good luck Hope this helps!