Speaking for myself, I've dreamed of simple labor when work gets frustrating, but I quickly tire and get bored of it when I do have it. In a state of "flow" however, there's no want for farm fantasies. The ideal for myself is a hobbyist means to work with my hands and turn my mind off - such as cooking, gardening.
I think for people like myself, the back-to-nature pursuits are reactionary ideas to stress or bullshit jobs. The appeal is emotional. In truth I have no interest in subsistence lifestyle.