NO ONE has ever been infected from a handjob, or from fingering, and you will not be the first in over 40 years. Even if you had cuts or scrapes, or a hangnail - this is NOT a method of infection. Read AnxiousNoMore's list of ways that you CAN be infected. If you do not do any of those things, you will never have to worry about HIV.
Your story is unclear. Did you penetrate with your penis or with your finger?