If you are taking the medication Prednisone and decide to stop, it is best to talk to your doctor about gradually reducing your dosage. This should minimize the risk of developing withdrawal symptoms. However, if you suddenly stop taking Prednisone, you can experience withdrawal symptoms that occur almost immediately and can last anywhere from 2 to 7 days, depending on the individual.