How bad is your cholesterol? Is your health risk high or low? These are the things you need to know. Many people are put on medication who don't really need it and before they try dietary methods of control, but others have dire problems that need stronger treatment. Now way we can know this, but you probably do.
Any discontinuation of medication should be discussed with a doctor.