sc077y

89 karmaJoined January 2, 202332 submissions

Software Engineer, currently working in genAI.

I'm just a student of the game.

Recent submissions

1

Ask HN: Questions about LLM context window

I've recently come to learn that filling the context window up completely makes the results worse and the llm struggles to acquire the tokens in the middle of the prompt. So my question is : Are there any studies on this and what is the appropriate fill for a context window ?

1sc077y1y ago0

Recent submissions

1

Ask HN: Questions about LLM context window

I've recently come to learn that filling the context window up completely makes the results worse and the llm struggles to acquire the tokens in the middle of the prompt. So my question is : Are there any studies on this and what is the appropriate fill for a context window ?

1sc077y1y ago0