Sorry to hear about the anxiety. I'm going through it myself atm.
Just to give my experience, my anxiety did lessen for the last 2 years that I've been on evorel sequi. It also regulated my cycle. I asked the doctor what if I didn't like it's effects and she said take the patch off and it's out of your system in 24 hours. She added it's not likely to give any uncomfortable effects.
The first time I put the patch on I was due to pick someone up from the station. I felt a bit brave as they were coming to visit me, so I put it on

Ten mins into the journey to get them, I got this minty cool feeling come over me. I didn't think I was having hot flushes, I still don't think I had them, but this feeling made me realise I'd been hotter than perhaps I would otherwise have been. it was like having a shower with mint gel or something. That feeling soon stopped as I got used to it, but I just started to feel better, across the board. I couldn't specify how when my friend asked, but I knew I felt more myself.
Whether or not to take hrt is a personal thing, I'm just giving my experience as for me it helped. Now, 2 years on I'm having a few issues and may need to change but I think it did really help.