I'm sorry that is happening! In a calm moment, have you pointed this out to him? A lot of men get aggressive and angry when they are suffering anxiety. I'm not sure why but it is a common dynamic. Certainly uncomfortable to be around and if it seems you are going to be the target for it, you don't want to be that.
I'd tell him where things are at. That he's doing X and it makes you feel scared and uncomfortable. See what he says. If he is able to see it himself and agree to work on it, go from there. If not, then cut your losses.
And never put yourself in a dangerous situation with a man that can blow up at you. Especially making a fist! That's crazy. Let us know how it goes.
Darling, it is time to leave -- the category of time known as "high time." Or, save-your-life time.
People who have suffered abuse or deep disappointed in things in their lives will sometimes react with unreasoning anger at the innocent people around them. But this is his problem to solve for himself (hint: therapist). When you have had this clear of a warning that this man is going to lash out, it is not time to wonder what to do. Hop on the bus, puss. Make a new plan, Ann. No need to be coy, Joy. Time to get out.