Ask HN: How Much a Difference Does an LLM's Corpus Make?

That is, were I to omit all, say, novels and non-fiction from my LLM's training would then scientific questions be better-addressed by that LLM vs another?

IOW is an LLM trained like a scientist indeed a better "scientific" LLM?