Are you thirsty a lot, too? Frequent urination and thirst need to be brought to your doctor's attention, because they could be a sign of kidney or other issues.
At least you are tapering down so hopefully things will settle down, soon.
My daughter tapered more slowly, but still had frequent urination and thirst...pretty much until she tapered completely off pred.