I think you hit the nail on the head, it does frustrate me. Not only because it's repeated often, but also because it's applied equally everywhere. Look at this project for example. It's an extension for arXiv, a pre print repository for cutting edge research, do we really need to keep the entirety of humanity in mind while making this? Because that's what the original comment was saying. The way I see it, arXiv is mostly looked at by experts who would know when something is completely off, and will probably look into things further than reading the GPT summary. If I was still actively doing research and hitting the site every day, this would have immensely streamlined my flow (maybe with a few tweaks to the prompt to emphasize certain sections which I'm usually more interested in).
But that's not how any of this is discussed. That's where my scope comment comes from, the scope of every project cannot be "for everyone and 100% safe from the beginning". In this way there is no encouragement to discuss/make better things, just discouragement. I, personally, hate this.