When I give instructions on the choice of certain words, ChatGPT gets it wrong. Why does it do this?

API
1

Hi !
I would like to give you this feedback.

I am french and I speak in french to chatGPT. recently I asked it this :

“give me 5 words without any e in their orthography”
(remember : the question was in reality in french, so I was waiting for 5 french words, following the instruction)

Result : 5 words and all with an “e” at their end !

I try several times to say to ChatGPT : “that is not correct, please redo the exercise”
ChatGPT always said “your are right I am sorry, here is a good answer …”

But always at the end the same error, witn the same or other words !
I do not try in English, perhaps it works ?

My question : why such errors for a so simple question ? funny, no :slight_smile: ?

2

I believe GPT-3 was mostly trained on English language. While it does do language translations, it might be stumbling in your french language request. Have you tried it in English?

3

No I have not tried In English, as I said, but I will do ASAP :wink: ! And I will give the results !

4

Hi !
You were right :grinning: PaulBellow !

Here are the results of my tests :

English
“Give me 5 words without any “e” in their orthography”
==>

  1. mynah
  2. myth
  3. pyx
  4. flyby
  5. byway

French
“Donne moi 5 mots en français qui n’ont pas de “e” dans leur orthographe”
==>

  1. mythe
  2. hymne
  3. symphonie
  4. pyxide
  5. mynah

German
“Nenne mir 5 deutsche Wörter, die kein “e” in der Schreibweise haben”
=>

  1. Mythos
  2. Hymmnos
  3. Symphonie
  4. Pyxis
  5. Myna

With this small test we have clearly the proof that chatGPT translates in English the question, answers in English, and you can see that the result is correct, and then globally translates in the target language the answer. And you can see that the problem is here because In French or in German the translated words can have an “e” in themself!

But another interesting point is that if you ask in French :
“Y’a-t-il un “e” dans “mythe” ?”
The answer is :
“Oui, il y a un “e” dans le mot “mythe” en français.”

I translate : “is there an “e” in “Mythe” ?” => “Yes there is an “e” in the word “mythe” in French.”

So the translation can also be smart in some cases :slight_smile: