I'm in the same boat.
My physical conditions cause me so much anxiety and Valium or Xanax are the only thing's that keep me calm.
I try not to take more than once or twice per week, but the temptation to take more is there.
Benzo tolerance and addiction can happen very quickly, especially if you take them daily. You can become addicted in as little as two weeks and from what I've read trying to come off them is absolute hell with withdrawal symptoms lasting months to years.
Unless you want to go down that path of addiction and withdraw, then I strongly advise to keep your use to a minimum, only when absolutely needed. Once per week should be OK, but even then in the log run tolerance and addiction can kreep up.
Part of me thinks we'll I'm fucked anyway, so might as well just give in and take them daily, but the other part of me wants to believe that I well get better, so don't want to add more problems to my already troubled life.