Jim,
My gut tells me that you should just sell.
I've owned all kinds of vacation homes, including a summer home now.
I sell them all the time, to all kinds of people.
When you start calculating how much they cost you per hour/day, it's time to sell.
From my experience, owners of vacation homes often fall into two categories;
1. Those that use them and abuse them... family memories for a lifetime.
2. Those that have them for status purposes. Stats report vacation homes becoming #1 status symbol among the wealthy.
If you're not prepared to enjoy the property without worrying what its costing you, then you should move on at this time, otherwise you'll just be agonizing over it instead of enjoying it? You can always jump back into the market at a later time.
My kids are young, we live at the lake for the summers..... I don't even want to know what it costs me!