Granted I haven't been able to completely taper off in the year and a half straight that I've been on it, but everytime we've tried, my rheumy has had me decrease 1 mg at a time, once I get below 10 mg. Any more than that and I really notice a big difference. Try tapering more slowly.