I’d call that a selfish way to approach it.   

1) The time you spend with your kids is planting a seed. Just like taking them fishing or hunting.   A 101% of the time you’ll be more successful without them but that’s not the point.  Hopefully when you’re an old codger they’re the one battling with the boat or shanty. 
2) If you go to “enjoy yourself “ without them you have to dump them on someone else.   Dealing with them is all part of the package of being a parent.