Does your husband smoke alot of pot? Any other drugs? How is his behavior when he is high?
With the things you've shared previously, your husband does not treat you well. This is not about choosing one side or another, this is about you. You deserve better and I think ultimately will be happier without this toxic man in your life. I am very pro family typically. I don't lightly tell a young mother to abandon her marriage but he's up and down in terms of his behavior toward you and I'd start a new life without him.
And I see this isn't what you asked. LOL I decided to leave this because I think that is advice you REALLY need to read. You've given information previously. Your gut probably knows how this is going to end . . . but you aren't ready to walk away. Your parents most likely have decent reasons to dislike him and they are worried about you. You would be very foolish to not keep in contact with your family. You most likely will very much need them in the future.
So, no, I'd not make this decision. And your husband is further isolating you from normal life if you do.
Go stay with your parents. I get that you don't want to hear it but there might be some reality in there that you need to hear. Your choice. but your husband has put you through a lot. And down the road, my guess some his character issues that have hurt you will resurface. good luck