Dulciana - your description reminds me of holidays with my parents in the years between stopping going away with my maternal grandparents and starting caravanning! They used to drag us at break-neck speed around sights (and sites!), up mountains (I have bad memories of a day up Snowdon!!), you name it! Hubby and I are much more chilled on holiday - we both work long hours, so holiday time is for relaxing. We do sight-see, visit places, museums, etc, but at a measured pace!
Could you suggest a couple of 'chilled' days by inserted into the itinerary of your next holiday? Or maybe a day (or even just half a day) when hubby does his sight-seeing thing and you stay at your accommodation and relax? It's your holiday too, after all.