Tell HN: Declaration of Independence is 100% AI, according to AI Checker

16 pointswhatamidoingyo4mo ago3 comments

My wife is a freelance writer/translator, and so many of her clients check her work with so-called AI Checkers, often making her rewrite her work until it scores below 30% (even if it was 100% her work in the first place).

If you're relying on these tools, please know that they're not accurate. At all. In fact, they're a waste of time. As an example, I pasted the first three paragraphs of the Declaration of Independence into one of these checkers, and the result: 100% AI generated via ChatGPT.

Edit: removed link to AI Checker site, as I don't want this to look like an ad. If you want to check, google "AI Checker", and test yourself.

3 comments

WheelsAtLarge4mo ago

I would think so. I'm sure it's one of the documents used to train the LLMs. It does not surprise me that a checker would think it was AI generated. I bet if you put any popular document, the same will happen.

True, people are putting too much trust into the checkers.

dbaman4mo ago

But is that first point really true?

If a document is used to train an LLM, that means that an AI checker would be more likely to give a false positive that the document is written by AI?

I guess it depends on the AI checker.

I would think that that LLM, after generating the fragment "When in the course of.." would just be a bit more likely to generate "human" as the next word, yes?

gus_massa4mo ago

Slightly related: During 2020 there was a problem with AI proctors that had too many false positives.

j / k navigate · click thread line to collapse