Good point; I've never had a vacation home that I didn't use, so I hadn't really considered that point, but it's likely a very valid point.
My summer home is 10 minutes from my residence..... we use it all the time
When we had the ski condo, we bought season passes and used it every 2nd weekend and all winter vacations (Christmas/Spring Break).
If I wasn't using the place, I likely wouldn't own it either.