You probably mean fruit flies (Drosophilidae). Maybe you have Candida overgrowth which produces a sugar called arabinose which then ends up in your sweat and attracts these flies. You could try some high dosed sodium selenite for some weeks which is antifungal.