agree with quincy about continuing the rectal meds, even a couple times a week
can you add a fiber supp like psyllium seed powder or psyllium husk (metamucil).
I have had similiar problem, once flare starts to subside i get a bit contipated