That could literally be a hair follicle or a little cyst that is normally harmless. Don't squeeze them! That's a straight route to infection and then you have a problem. In fact, try to leave it alone. Try to keep your hands off of it. Next visit you have with your doctor, mention it. But I wouldn't personally be worried especially since they never hurt and go away.