undefined | Better HN

0 pointsstaticman21y ago0 comments

Google AI Studio offers no system prompt option for Gemma 3 which also suggests this model doesn't support it...

0 comments

The official ggufs have this in them as an example, I'm even more confused now:

<start_of_turn>user

You are a helpful assistant

Hello<end_of_turn>

<start_of_turn>model

Hi there<end_of_turn>

<start_of_turn>user

How are you?<end_of_turn>

<start_of_turn>model

I was confused by this too, but now I think they’re just suggesting to prepend the system prompt to the first user prompt.

I think the ggufs took the chat template defined in tokenizer_config.json , which basically does that.

j / k navigate · click thread line to collapse

The official ggufs have this in them as an example, I'm even more confused now:

<start_of_turn>user

You are a helpful assistant

Hello<end_of_turn>

<start_of_turn>model

Hi there<end_of_turn>

<start_of_turn>user

How are you?<end_of_turn>

<start_of_turn>model

I was confused by this too, but now I think they’re just suggesting to prepend the system prompt to the first user prompt.

I think the ggufs took the chat template defined in tokenizer_config.json , which basically does that.

j / k navigate · click thread line to collapse