First, don't thow the pills out. If you go to refill your prescription early, they may not do it unless you turn in the old pills.
Capsules will start to dissolve (slowly) in water - I think. Personally, I would wipe them off, and then just before you take one rinse it off. Myself, I would not even bother with the rinse, but I don't know what they landed in.