I don't think you have anything to worry about, though you should always talk to your doctor about your concerns, and any supplements you take. This article: https://ods.od.nih.gov/factsheets/VitaminB6-Consumer/
only warns of excess vitamin B6 consumption lasting over a year. It seems doubtful that a few weeks will do any harm.
I agree. Try not to worry. Tell your doctor at your next check up that should be sometime in the next 4 weeks. But I think you'll be okay. You were taking too much but not for long enough to do the harm you are worried about. Ask your doctor for confirmation. Congrats on the pregnancy by the way!! Is this your first?