undefined | Better HN

0 pointsnl3mo ago0 comments

I guess the op was implying that is something fixable fairly easily?

(Which is true - it's easy to prompt your LLM with the language grammar, have it generate code and then RL on that)

Easy in the sense of "it is only having enough GPUs to RL a coding capable LLM" anyway.

0 comments

If you can generate code from the grammar then what exactly are you RLing? The point was to generate code in the first place so what does backpropagation get you here?

nlOP3mo ago

Post RL you won't need to put the grammar in the prompt anymore.

measurablefunc3mo ago

The grammar of this language is no more than a few hundred tokens (thousands at worst) & current LLMs support context windows in the millions of tokens.

nlOP3mo ago

Sure.

The point is that your statement about the ability to do RL is wrong.

Additionally your response to the Deepseek paper in the other subthread shows profound and deliberate ignorance.

1 more reply

j / k navigate · click thread line to collapse

0 comments

measurablefunc3mo ago

If you can generate code from the grammar then what exactly are you RLing? The point was to generate code in the first place so what does backpropagation get you here?

nlOP3mo ago

Post RL you won't need to put the grammar in the prompt anymore.

measurablefunc3mo ago

The grammar of this language is no more than a few hundred tokens (thousands at worst) & current LLMs support context windows in the millions of tokens.

nlOP3mo ago

Sure.

The point is that your statement about the ability to do RL is wrong.

Additionally your response to the Deepseek paper in the other subthread shows profound and deliberate ignorance.

1 more reply

j / k navigate · click thread line to collapse