HPV is easily spread but mostly from genital skin or oral sex. From objects, HPV is very difficult to spread. The virus is not in semen. It is in the genital skin and oral cavity.
HPV warts can be located inside your rectum, so you may not be able to see them. Go see a proctologist for a rectal exam. Your doctor will look into your rectum with a device to see if any warts are hidden there. Even straight men (who never had anal sex done to them) are getting anal warts. Some gay men are getting anal smears (similar to pap smears) to see if they are infected with HPV. Not sure whether a proctolgist provides this type of exam or not.
In conclusion, always play safe always. Understand that condoms provide 50% protection against HPV and Herpes but it is safer than no condoms. Reduce the number of partners and lead a healthier life.