Do I Have Gluten Intolerance or IBS?

I am 27 years old and have been told since I was 18 that I have IBS. At first I suffered from IBS-D, however for the past 6 years I have suffered from constipation, gas, and bloating. I have been to a family physician, gastroenterologist, and chiropractor/herbal healer, and they all prescribed me something that DID NOT WORK. The medicines actually made it worse. The only thing that has helped over the years was to take Benefiber on a daily basis and eat Activia and that only helped for a few months. It was like I became immune to them after awhile. I was told by my doctors that I could have gluten intolerance, but there is no real way to test it, other than trying a gluten free diet. Are these symptoms that a gluten intolerant person would have? I use the bathroom only 1-2 times a week, feel 5-10 lbs heavier than I am due to the bloating, and I have horrible gas. I just want to make sure before I cut gluten out of my diet, because my favorite foods have gluten in them :(