Hi hippiechild,
I've never been on valium but it sounds like a nasty side effect from it that shouldn't be tolerated. There are lots of other medications for treating anxiety and I would contact/call you doctor and let him know what is happening with you and ask him to prescribe another choice for you.
Good Luck.