Pain in upper right side where my gallbladder is

I was diagnosed with IBS-D about 4 years ago.  Other than the diarrhea being the worse sympton I've been dealing with it until recently.  In November I had severe pain right under by rib cage on the right side. I went to urgent care and they sent me to the emergency room. They did a c-scan and blood work and couldn't find anything. I then went to a digestive dr. who in turn did a colonoscopy with a biopsy, MRI, ultrasound of the gall bladder and stool samples. The samples came back normal. The MRI was normal (other than spots on the liver which the dr. who specializes in the liver said it was nothing to worry about) ultrasound found no gall stones and the colonoscopy only showed an irritated stomach which he said could be from stress. Now to the point.  The pain I have been experiencing over my gall bladder keeps coming back and none to kindly. I'm also very nauseous when I'm this pain.  I'm just wondering if I should think about having my gall bladder removed or is this just another effect of the IBS.  Any help would be greatly appreciated. I am scheduled to see a surgeon next Thursday.

What exactly is a HIDA scan. And no the ultrasound did not reveal any stones. I don't think my doctor really suspects gallbladder. He wants to put it on the IBS. Once you have IBS and they can't figure out what's wrong, they blame it on IBS. I asked him before we did the MRI and ultrasound it thought it could possibly be the gallbladder but he never said. I did have a polyp and it was sent off with negative results. I just don't think its the IBS and thats why I thought about seeing a surgeon about my gallbladder.