When I'm looking at some pattern that I'm trying to find a rule for in real-life, I don't think I'm running into the same frustration and in fact greatly enjoy trying to figure out rules for how things work (or so I believe, at least).
I think a crucial difference is that I know that the problems I encounter in real-life are only "as complex as necessary", and the data I'm looking at is a direct result of some process that serves a specific goal; presumably one I think "makes sense", as I wouldn't look for a rule otherwise. In contrast, puzzles are made to be complicated on purpose, and I suspect that annoys me subconsciously to the point where my brain complains about engaging with it. But it's only these kinds of "figure out the rules" puzzles, so there has to be another important difference compared to logic puzzles. Possibly the difference is: for the logic puzzle, the "meta-rules" for the problem are made explicit and I know the solution-space exactly. For the Bongard problems here I found myself thinking for example: "wait, is it always just two groups distinguished by single rule, or can there be dependencies on the positions of the symbols within the groups as well? What kind of solution am I even looking for?", and that also apparently frustrates me.
Sorry for the wall of text, but I've actually been trying to figure out why these kinds of problems get on my nerves for quite a long time, lol.