As long as it's not giving you any trouble, I think it's fine to wait and watch it. I had a gallbladder full of stones. Even after my first attack that landed me in the ER I decided to ignore it (that and because they didn't find the stones at the time, assuming I had one that passed). A year later I had another major attack that sent me straight to the ER, that is when they found my gallbladder full of stones and VERY swollen. I had surgery a week later.
My Mom had hers out early in August. She had suffered from minor attacks for what I believe was a few years, only she thought it was a stomach ulcer. Being stubborn she never went to the doctor. In July she ended up in an ambulance TWICE. The first attack was so bad, the pain, vomitting and D she had made her dehydrate to the point where she didn't know where she was, who she was, or that we were even there! That was very scary! They didn't even do an u/s that night so a few weeks later, I had to call another ambulance. She was in so much pain! She had it out a few days later, and boy they said it was really hard to get out, and in terrible shape!
So I would just really keep an eye on things. They seem to really go down hill fast those gallbladders when they want to! The attacks just get more sever and more often with time. For what I went through, and my Mother will agree. We both wish we would have just had it out sooner. The surgery was a breeze compared to those attacks!