Sounds quite possibly like skin tags. Time for an appointment!
Sounds like you have external hemmroids. You might want to get to your doctor and have them checked out. If they are painful, you can get some stuff called Nupercainal Ointment. It is an over the counter medication kind of like Preparation H, but you have to ask the Pharmacist for it. It works great to numb the area. Best of luck to you.