undefined | Better HN

0 pointsorbital-decay10mo ago0 comments

Prompting a good LLM to convincingly act like a native isn't hard, neither is jailbreaking it if necessary. The hard thing in this case is verifying that it really does that.

0 comments

overfeed10mo ago

You're assuming prompting an LLM to behave like X will automatically result in the LLM behaving like X for any X. Some things are out of the LLMs ability: I'm sure you'll get something if your prompt is "You are a 300-IQ nuclear physicist with a doctorate in material science. Describe the design of a cold-fusion reactor", but there is no guarantee the LLM has fidelity to your prompted persona, though it will try to give its very best impression.

orbital-decayOP10mo ago

I'm not assuming, I'm a native speaker and I describe actual experience with Claude. It's pretty good at roleplaying and major languages, with certain caveats. If you aren't a native speaker though, you'll have a hard time verifying that it gives you a good result, that's what I'm trying to say.

ivan_gammel10mo ago

Nah, it's not reproducible. It can certainly give you some common phrases, but to create an entire personality with its own set of speech patterns is a different thing. For example, Claude can suggest following friendly conversation starters to sound like a native (a quote below):

   Popular combinations for texts:

   "Прив! Чё как?" - "Hi! How's it going?"
   "Дарова, живой?" - "Hey, you alive?"
   "Салют! Как сам?" - "Hey! How are you?"
    
   Modern slang (especially among younger people):
   
   "Хай" (Khay) - borrowed from English "hi"
   "Йоу" (You) - borrowed from English "yo"

When asked, which one it would pick, it goes with "Дарова, как сам?" (Darova, kak sam?) and that already sounds odd in many contexts.

hn-shithole10mo ago

That's not how you'd approach this with an LLM

ivan_gammel10mo ago

Obviously not. But this is what LLM may give you, unless you know exactly what to ask for (which you will not know without the proper knowledge of language and cultural context).

tclover10mo ago

lmao if you start conversation like this, other person will think you’re 12 years old

ivan_gammel10mo ago

Exactly. And without the knowledge of the language you will never figure out that LLM made you a teenager.

taneliv10mo ago

It's perfect. Just claim it is "your mom's computer" that needs help. Continue pretending to be a 12 year old.

... unless they still get a whiff you might be an impostor and ask, say, something about school. Good luck getting LLM to answer in a believable way.

j / k navigate · click thread line to collapse

0 comments

overfeed10mo ago

orbital-decayOP10mo ago

ivan_gammel10mo ago

   Popular combinations for texts:

   "Прив! Чё как?" - "Hi! How's it going?"
   "Дарова, живой?" - "Hey, you alive?"
   "Салют! Как сам?" - "Hey! How are you?"
    
   Modern slang (especially among younger people):
   
   "Хай" (Khay) - borrowed from English "hi"
   "Йоу" (You) - borrowed from English "yo"

When asked, which one it would pick, it goes with "Дарова, как сам?" (Darova, kak sam?) and that already sounds odd in many contexts.

hn-shithole10mo ago

That's not how you'd approach this with an LLM

ivan_gammel10mo ago

Obviously not. But this is what LLM may give you, unless you know exactly what to ask for (which you will not know without the proper knowledge of language and cultural context).

tclover10mo ago

lmao if you start conversation like this, other person will think you’re 12 years old

ivan_gammel10mo ago

Exactly. And without the knowledge of the language you will never figure out that LLM made you a teenager.

taneliv10mo ago

It's perfect. Just claim it is "your mom's computer" that needs help. Continue pretending to be a 12 year old.

... unless they still get a whiff you might be an impostor and ask, say, something about school. Good luck getting LLM to answer in a believable way.

j / k navigate · click thread line to collapse