Everything I have read on taking a "holiday" is that it really does not make much of a difference. Especially with just a few weeks, your tolerance would be right back after a few days. Even when taking months off, your tolerance will come back albeit not as quickly with being off for months. Your meds would seem to work better for a few weeks if that and then you would be right back.
Now everyone is different so it would not be the same results for everyone and if this is something you really want to do then I am in agreement to speak with your doc. But if you are wondering is it really worth it, from what I have read no, it just does not seem to last long enough. But again, just my opinion!!