How long has it been there? Did you use tweezers to pluck the hair? It's possible that you left a part of the hair in, which is causing an ingrown hair. They can go away on their own, but it does take time. Make sure you keep the area clean and I wouldn't recommend picking at it- that may cause the issue to get worse.