If its one of these do they heal on their own? Do you suspect ocular herpes? Nothing is oozing and it just feels like something is constantly in my eye.
You need to see an ophthalmologist. While this may not be ocular herpes, you could have a corneal abrasion or corneal ulcer which needs treatment. Do not wear the contact lens until you see the ophthalmologist.