Paulos,
This is just my story about xanax, not maent to judge or scare okay?
I was put on 2mg xanax when I was 17, by the time I was 20 I was on 6-8mg a day. This was not a helpful dose for me so I took time under a doctors care to swap it to 60mg valium which I then reduced down to 5mg and stopped altogether for a period of time.
IMHO (others may disagree!!! lol) - this has not affected my personality or my intellect and I do not suffer from memory loss from the xanax.
Honestly it was a bit tough changing meds and cutting down, but I know you have done this yourself with your own meds and succeeded. 3mg is not a huge dosage. I would not be concerned unless it creeps up to a very high dose.
Again, this is an issue best discussed with your doctor. Do what YOU feel is the best thing for you in this situation.
Meg