My guess is your psychiatrist thinks this is okay because you've only been on the drug for a short time. It's also often true that when a drug doesn't work, it means you didn't metabolize it very well, and that means it's easier to stop taking it. But, I'd still taper off at least as slowly as you tapered up, just to be safe, and if withdrawal sets in as you do this, then you need to taper off more slowly. People have wildly different reactions to stopping these meds, but it's just safer to be cautious. I'd have a talk with your psychiatrist, because if he seems not to be careful with this or is non-responsive to your concerns, he's probably not a very good psychiatrist to have if you plan to continue with the medication route.