In theory, it's possible, but you'd have to touch your genitals, mouth or eyes pretty quickly after they touched their outbreak and then touched the object. They'd also have to touch the object pretty quickly after touching their outbreak.
This isn't something you need to worry about with casual touches of objects. Circumstances would have to be exactly right for this to happen, and if it were this easy, everyone would have herpes.