I would suggest you to track ovulation very carefully and make love in those days without miss; that could help.
I would have your regular ob-gyn recommend a fertility specialist (reproductive endocrinologist) sooner rather than later. I'm 38 and been trying to conceive for nine months, and found out I have low ovarian reserve, so not sure if IUI or even IVF (with my own eggs) will work yet. We are going to try IUI and see how I respond to the medications. Your eggs might be fine at 41, or they might be getting depleted. They can test your FSH and E2 levels, and also make sure they test your AMH level. Mine is very low, so not sure if anything will work, but we're going to give it a try.
See your ob-gyn for advice. You might want to go onto Clomid or have IU!. Both of those are minimal assistance.