You are overreacting. :)
First, if this is herpes, you'd have hsv1 on your lips, and IF you gave yourself herpes via this toy, you'd give yourself hsv1 genitally. There are different strains of the virus - the number doesn't signify the location.
That said, if this is hsv1, you have antibodies (unless this is a new infection) which protect you from infecting yourself in another part of your body (and also protect you from someone else giving you hsv1 genitally - think receiving oral sex).
Your sore is gone, no lingering cuts/bumps/abrasions. This makes it less likely that you would transmit anything to yourself.
So chances are really, really good that you didn't infect yourself genitally (this is called autoinoculation, by the way). It's not something I'd worry about at all. :)