It sounds like maybe your fever was breaking, and your body was busy trying to reset it's normal temp. Also, you had sweat on your body, which when air hits it with an unregulated body thermometer, it's going to feel cooler than normal.
Or it could have just been the way your body was fighting the illness.
It does sounds normal, if your fever was breaking. We can't go back and assess anything, but you're fine now, seemingly, so I wouldn't worry about it at all.