I too get that reaction from my mum who smugly reminds me she "sailed through it" in her 50s (my memories of her at that time are slightly different lol) and though she hasn't said it, I know she thinks I should "pull myself together".
Though I feel sad that all this has happened to me before I was able to have children, looking at it the other way, it must be so hard for you guys to have to worry about them as well as everything else. I'd hoped this year to go for a promotion at work, but I had so many days where I literally 'counted the minutes til home time' last year, that I am now too afraid to take on any additional stress. This wouldn't have crossed my mind in my 20s or 30s. Have any of you found it affects work too? How have you dealt with it?