Never went anywhere on any type of trip when I was little. Got old enough to be help on the farm, went to Grandparents in OK every summer. Worked my tail off from daylight to noon, then the rest of the day was mine. Enjoyed the heck out of that. Got married and started taking a couple of weeks every summer when the kids were out of school.  Retired now and will jump in the car or pickup at the drop of a hat. Doesn't make any difference where, just gonna go for a week or two.

The way you and your wife handle things is totally up to the two of you. I would suggest that this is definitely an issue that you need to compromise on. Not a big deal and you will look good when you agree to take a short trip. Save the bullheadedness for something important.