It sounds like you may have answered your own question. Being so rough on the skin of the penis will certainly irritate it from both friction and stress from frequently being pulled very hard. The skin will heal up after a few days if you leave it alone; after that, be gentle.