Of course the last sentence should read "It should not be a big deal to you".
Welcome to the STD forum. I'll try to help.
Your situation, although not typical, isn't a rare one either. Anal warts are not at all rare in strictly heterosexual men. The exact mechanisms of anal inoculation aren't clear, but probably involve local spread from the genital area, or perhaps inoculation by hand contact, e.g. after touching the genitals -- or by spread of secretions during sex, even though there is no intended direct anal contact.
As for the ultimate origin, if your wife indeed is your only lifetime sex partner, it's a good bet you caught it from her. But maybe not. Some HPV infections of the anal or genital area might be due to common skin wart HPV types, i.e. not acquired sexually. A certain small percentage of genital (or anal) HPV infections have mysterious origins, i.e. are simply unexplained. Whether there are true exceptions to the usual sexual route of exposure simply isn't known. There is no known link with public hygiene in any country.
There should be little if any risk to your daughter. Using common-sense hygiene in your home makes sense. Most important, wash your hands with soap and water after you use the toilet. Do that and there should be no risk whatever to your daughter. (Even if you don't wash carefully, the risk she will catch your infection still would be very low. But it's just common sense to do it.) Of course, most children catch HPV infections (non-genital, non-sexual types) at one time or another, generally from other children. So your daughter someday may develop warts of the hands, feet, etc. If and when that happens, it won't be from you.
Please look at this as a minor health concern -- an inconvenience, not a serious health risk to you, your wife, your daughter, or anyone else. It should be a big deal to you.
I hope this helps. Best wishes-- HHH, MD