"You develop an appreciation for the folks that do this for a living."

That's the difference. Even fishing would get to be work if you HAD to do it every day, with quotas and deadlines. You can enjoy it because it's a change from your regular duties and you don't have a strict deadline.

The difference between work and hobby is perspective. I am reminded of Tom Sawyer and the fence.