ChatGPT-3.5 discrepancy in random order arrangement

[mendoza.migz]

I instructed ChatGPT-3.5 to rearrange the Hiragana characters in a random order while ensuring they only appear once. Even after multiple attempts and follow-ups, the same issue occurs across multiple characters. See photo below for sample reference.

[_j]

This is a task that gpt-3.5-turbo cannot perform, even on the API with minimum top_p parameter. gpt-3.5-turbo-1106 was markedly worse still.

Exacting instructions with middle steps to allow easier contemplation by AI:

Input:

あいうえおかきくけこさしすせそただぢつてとなにぬねのはひふへほまみむめもやゆよらりるれろわゐゑをん

---

Task list (output all in a single response):

1. Title: input list. Print the individual characters of input each as their own items in an ordered numbered markdown list.

2. Title: output list. Then produce a numbered output list, where you pick and shuffle around the characters of input randomly. Be very observant when generating the next character that it has not already appeared in the output list, as repetition is prohibited.

3. Title: Final text. output characters from that final shuffled list as a single line appended together (similar to input format).

It can write the python code to shuffle characters of input though…

---

OG API GPT-4 at top_p=0 can do it.

GPT-4 output

Title: input list

1. あ
2. い
3. う
4. え
5. お
6. か
7. き
8. く
9. け
10. こ
11. さ
12. し
13. す
14. せ
15. そ
16. た
17. だ
18. ぢ
19. つ
20. て
21. と
22. な
23. に
24. ぬ
25. ね
26. の
27. は
28. ひ
29. ふ
30. へ
31. ほ
32. ま
33. み
34. む
35. め
36. も
37. や
38. ゆ
39. よ
40. ら
41. り
42. る
43. れ
44. ろ
45. わ
46. ゐ
47. ゑ
48. を
49. ん

Title: output list

1. ぬ
2. ね
3. ふ
4. へ
5. ほ
6. ま
7. み
8. む
9. め
10. も
11. や
12. ゆ
13. よ
14. ら
15. り
16. る
17. れ
18. ろ
19. わ
20. ゐ
21. ゑ
22. を
23. ん
24. あ
25. い
26. う
27. え
28. お
29. か
30. き
31. く
32. け
33. こ
34. さ
35. し
36. す
37. せ
38. そ
39. た
40. だ
41. ぢ
42. つ
43. て
44. と
45. な
46. に
47. の
48. は
49. ひ

Title: Final text

ぬねふへほまみむめもやゆよらりるれろわゐゑをんあいうえおかきくけこさしすせそただぢつてとなにのはひ