Nope. Herpes infects nerve groups, and genital herpes infects the sacral ganglia. This means that you can get outbreaks anywhere in the area that boxer shorts cover. Lots of people get outbreaks in the same spot each time, but lots also don't.
How frequent are your outbreaks? If they are happening a lot, consider suppressive therapy, like valtrex or acyclovir daily. Talk to your doctor.