Are you self diagnosing as having RA or have you been diagnosed. Is it both hands or one? There is something called trigger finger which is when you can't bend one or more fingers of the hand. https://www.nhs.uk/conditions/trigger-finger/ It involves inflammation of the tendon. https://www.healthline.com/health/trigger-finger
Rheumatoid Arthritis can also cause these symptoms as you know. https://www.assh.org/handcare/condition/rheumatoid-arthritis See your doctor. They will examine your hands. Then take X rays and if they suspect RA, do blood work to confirm. It's treatable.
So either way, you should see your doctor. Do Nsaids help at all?
Hello~It sounds like you have a type of arthritis, I suggest that if it continues you see your GP for some tests.