As with any type of medication, stopping it suddenly can cause serious withdrawal symptoms. This is particularly true in the case of a steroid called Prednisone. Make sure to always follow your doctor’s instructions. If you are planning on discontinuing the drug, talk to your doctor so that he/she can gradually taper off the dosage. This will minimize the risk of suffering withdrawal problems.