I know it's really hard, but for most, the more you do, the better you will feel! It just takes your mind off it. If you can get home easily, so much the better! I have been in restaurants and had to leave due to panic attacks! I sit outside, sometimes cry, then go back in and face it! For 6 months I was basically housebound through fear and I am never ever going back to that! Cbt helped me a great deal - have you been offered this?
I also (and it seems I am in a minority) could not cope on estrogen without daily progesterone - the anxiety was just horrific! I now take daily progesterone and after 4 weeks settling in period, am happy as a camper. As time goes on you will learn your body and what works for you - keep a diary of how you feel - it definitely does get better ....