I don't know enough about male factor infertility to make any comment, but try going here:
This is the link to the Med Help Fertility forum, and I'm certain there are ladies there whose husbands have male factor infertility, and they may be able to help you.
Check back here, though. There might still be someone who has been through this and will comment.
but do check out the Fertility Forum.