And when you think about it,  the Biblical Jews were living in a land that was more like your "here", than like my (or others) "here".  So, thinking about it from that perspective, the idea of fallow makes sense, but it should be a locality-based decision.