Ask HN: How much of LLM coding skill comes from StackOverflow?

3 pointsryeguy_2410mo ago1 comments

I’m just curious. Does anyone have a rough estimate or guess of how much an LLM coding skill is attributable to Stack Overflow content (from training)?

1 comments

spooneybarger10mo ago

I would guess a lot as the best LLM coding answers I get often can be found on SO when I start searching for similar language.

But I have not been methodical about looking into it as "when does this random token machine spit out useful results" has been my focus far more than "what are the actual texts it is pulling from"

j / k navigate · click thread line to collapse

Ask HN: How much of LLM coding skill comes from StackOverflow?

3 pointsryeguy_2410mo ago1 comments

I’m just curious. Does anyone have a rough estimate or guess of how much an LLM coding skill is attributable to Stack Overflow content (from training)?

1 comments

spooneybarger10mo ago

I would guess a lot as the best LLM coding answers I get often can be found on SO when I start searching for similar language.

But I have not been methodical about looking into it as "when does this random token machine spit out useful results" has been my focus far more than "what are the actual texts it is pulling from"

j / k navigate · click thread line to collapse