Ask HN: Is anyone with AI expertise analyzing JFK files?

16 pointstheoryofx1y ago11 comments

The JFK Files, some of which were just released today, are thousands of text-based PDF files. They seem like a really good match for the capabilities of current LLMs.

Is there anyone who's making a serious attempt at extracting data and analyzing the JFK files?

11 comments

hbcondo7141y ago

Yes: JFK Assassination Files Chatbot

https://news.ycombinator.com/item?id=43407685

theoryofxOP1y ago

Okay this looks pretty good.

Also just found https://github.com/amasad/jfk_files although it's only 1000 files or so.

13years1y ago

Mention a few here, but my intent of writing this was mainly a warning of don't put much weight into any AI analysis.

https://www.mindprison.cc/p/ai-analysis-of-the-jfk-files

eriktheviking811y ago

I built one with a graph DB based RAG approach at https://www.jfksearch.ai

Terr_1y ago

Exactly what use-case do you think LLMs would help with?

They might help people who don't know the exact terms or synonyms they want to search for, but they don't make logical inferences or detect contradictions. If anything there's a risk that they'll inject bias from blogposts and fiction-books and conspiracy-stories present in all the training-data.

theoryofxOP1y ago

Yeah, I expect it'd mostly be useful for OCR and search. These are hard to read PDF files and there's a lot of them.

I found a few projects related to using AI with The JFK Files but they all seem old or uninteresting. Which is why I'm asking here.

Terr_1y ago

Some prior discussion prompted by "Why LLMs Suck at OCR": https://news.ycombinator.com/item?id=42966958

1 more reply

StanislavPetrov1y ago

I think one useful use-case would be having an LLM compare today's release with what has been released in the past so one could focus on what was actually newly released (or redacted).

dragonwriter1y ago

Yes, and the conclusion is that the JFK files released today are the exact same set released under Biden with a new cover sheet on the package.

theoryofxOP1y ago

Is this "conclusion" based a single social media post?

I'd expect that at the very least this release includes fewer redactions.

But I have yet to see anyone do the analysis.

j / k navigate · click thread line to collapse

11 comments

hbcondo7141y ago

Yes: JFK Assassination Files Chatbot

https://news.ycombinator.com/item?id=43407685

theoryofxOP1y ago

Okay this looks pretty good.

Also just found https://github.com/amasad/jfk_files although it's only 1000 files or so.

13years1y ago

Mention a few here, but my intent of writing this was mainly a warning of don't put much weight into any AI analysis.

https://www.mindprison.cc/p/ai-analysis-of-the-jfk-files

eriktheviking811y ago

I built one with a graph DB based RAG approach at https://www.jfksearch.ai

Terr_1y ago

Exactly what use-case do you think LLMs would help with?

theoryofxOP1y ago

Yeah, I expect it'd mostly be useful for OCR and search. These are hard to read PDF files and there's a lot of them.

I found a few projects related to using AI with The JFK Files but they all seem old or uninteresting. Which is why I'm asking here.

Terr_1y ago

Some prior discussion prompted by "Why LLMs Suck at OCR": https://news.ycombinator.com/item?id=42966958

1 more reply

StanislavPetrov1y ago

I think one useful use-case would be having an LLM compare today's release with what has been released in the past so one could focus on what was actually newly released (or redacted).

dragonwriter1y ago

Yes, and the conclusion is that the JFK files released today are the exact same set released under Biden with a new cover sheet on the package.

theoryofxOP1y ago

Is this "conclusion" based a single social media post?

I'd expect that at the very least this release includes fewer redactions.

But I have yet to see anyone do the analysis.

j / k navigate · click thread line to collapse