> It's hard to argue that they are getting thrills at the direct expense of an unknowing party, if they don't get caught.

"It is only bad if you get caught" is an absurd justification for anything. Is it okay for me to break in and stay in your home while you are away, if you don't find out?