Can you masturbate and ejaculate? Does that have to be "rough" too? What about oral sex?
If you can orgasm through other, more gentle ways outside of intercourse, I'd say it's not medical. Are you trying different positions to see if that helps?
It's not that unusual for men to need the friction and speed to orgasm, but I guess I'd wonder how rough you're talking about.