When it begins to affect your personal relationship in a way that is not mutually acceptable!
I agree with above. When it becomes something as well that someone is defensive about and they refuse to discuss the issue with you without anger because it is THAT important (more important than your feelings) to them. good luck