No one on my mom side is bald but my dad is
There are different patterns of balding, for most people, it is a VERY gradual process, over years (like 10 or more).
It could be, that due to your anxiety, you are overanalyzing everything. You can ask your doctor about it, but unfortunately, there is little you can do if you're going to be a victim of male pattern baldness.
You can get an indication by assessing the males on your mother's side (your maternal grandfather, uncles). Balding is typically a trait that comes from the maternal side. So, if your Mom's Dad has a beautiful head of hair, you just may be okay.
Personally, it's not something worth worrying about too much, as it is outside your control. We have enough to worry about in life than to add things we can't control.