Towels don't get "infected" - people do.
HPV can not be spread by sharing towels or clothing - it doesn't live outside a human host. Hands are also not an effective way of spreading STDs.
You have no risk here.
You can spread fungal infections like jock itch and yeast when sharing towels, though. You should always use your own towel.