I am sorry you are going thru this. I had a doc who did this and it was a disaster. I stay with my PCP because of this type of thing. Maybe you could quit the pain clinic and explain things to your doc. I am hoping that you don't end up with the withdrawals.
If you are happy with the pain clinic otherwise maybe they can taper you down off the meds. I don't know if I would trust a doc that didn't think about issues with stopping meds cold turkey. Good Luck!