"I'd like to live closer to family, and my current work situation makes that impossible."
"I'd like to move back to my hometown, but there aren't a lot of on-site opportunities there, so I'm hoping to get a remote position so that I can move back."
You get the idea. You can be vague and still truthful, so that you stay under the radar.
On a side note, it's very odd that having a wife and kids is something you now have to consider "hiding". Interesting times.