Going back to your dentist to have occlusal adjustment of temporary crown is advised. In addition, proper contour and smoothness of crown margin need to be established.
There could be several things that could be causing this. If the temporary is not covering all of the tooth and there is leakage, a temporary that is sticking too far down into the gums, a temporary that is slightly higher than the rest of the teeth so when you chew, you hit on a certain spot or spots. It could also be a tooth that has a crack in it, it could be that the cavity was too deep. There could be a hairline crack or a deep crack on the tooth, etc. First thing is first, call the dentist and tell him what is going on and you need to be seen before this irritation causes irreversible damage and have them help you. If you needed a crown because there was a crack on your tooth, or you had chipped or broken your tooth, then I would ask, why did it happen in the first place. Right now, you have just masked and put a band aid, over the problem, but you have not gotten rid of the cause of the problem which will manifest itself in many different ways. You can go to the www.top3dentists.com and go to the General Dentistry category, you will see some before and after photos with stories associated with them, see if you can relate to any of those. It might help you.