I agree!

when DH and I were first together all I wanted was for us to be together

- as we got more money behind us we talked about doing other things such as holidays, initially camping - when we bought a dog and my anxiety levels became awful, we went self-catering which suited us …… and the dog. We also used quiet pet friendly hotels but I wasn't able to go down for meals.
With the help of medication I eventually managed to face the breakfast room and rarely have the same worries these days. We also bought a small camper van - spending some of our Pension - whereas years ago I would never have considered using 'shared' facilities!
Acceptance will come. You need to grieve for the loss of the French dream which you both enjoyed. Then you will be able to move to where you need to be ………. fortunately we are able to be together and enjoy each other's company. (see my PM to you ;-) )