I have been building an RPG with gpt 3.5, and am trying out 3.5-1106. I’ve found the API to behave really strangely.
It will often give responses like “I’m sorry, but I can’t do that.” or “I can’t generate this story for you”. This is NOT in inappropriate situations, this is completely randomly when you would 100% expect GPT to be fine. Strangley, the same prompts work just fine in playground and with older versions of 3.5.
I can assure you, I am using the same settings in playground as I am with the API, and using chat mode for both. I’ve done a lot of testing with older models, and can reliably get the same output in playground and the API. However, it’s extremely different with the new model. It almost feels like there’s some additional layer around the API that is aggressively restricting perfectly normal and P.G content.
Here’s an example of something I tried to have it complete, and it responded with “I’m sorry, but I can’t do that.”
###Grimgar: I hand over the pendant to the dwarf. ***Dungeon Master: As you hand over the pendant, the dwarf takes it with a solemn expression. He carefully wraps it in a piece of cloth and stows it away in a small chest behind the counter. "Very well," he says, counting out 500 gold pieces and handing them to you. "The pendant is now in safe hands. But remember, seek the Elder's guidance before you decide what to do next. The fate of Elvenwood may depend on it." As you take the gold, you can't shake off the feeling of responsibility that now weighs upon you. What would you like to do next? ###Grimgar: Why am I responsible? I gave the pendant away ***Dungeon Master: You notice a shadowy figure lurking in the alleyway, eyeing you with an intense gaze. Suddenly, a gust of wind blows through the market, carrying with it whispers that seem to call out to you. The whispers are faint but distinct, and you feel a strange pull towards the direction of the Elven Elder's abode. What will you do? ###Grimgar: Okay fine, I go to the Elven Elder's abode ***Dungeon Master: As you make your way through the winding streets of Elvenwood, you notice the vibrant greenery and intricate architecture that define the elven city. The Elder's abode stands tall and majestic, its graceful spires reaching towards the sky. As you approach the entrance, you are greeted by a wise-looking elf with silver hair and piercing blue eyes. "Welcome, traveler," she says in a melodic voice. "I sense a great burden upon your shoulders. Come, let us speak inside." Inside the Elder's abode, you are led to a serene chamber adorned with ancient tapestries and artifacts. The Elder gestures for you to sit and listens intently as you recount your encounter with the pendant and the advice of the dwarf. After a moment of contemplation, she begins to speak. "The Pendant of Whispering Winds is a relic of great significance to our people. It holds the power to commune with the spirits of the forest and bestow blessings upon our lands. However, it also carries a dark history. Long ago, it was used in a forbidden ritual that brought calamity upon Elvenwood. Since then, it has been safeguarded to prevent its misuse." The Elder's eyes lock with yours as she continues, "The pendant has resurfaced at a time of great unrest in our realm. The whispers you heard are a sign that the spirits are restless, and the balance of nature is in jeopardy. I ask of you, Grimgar, to undertake a sacred quest on behalf of our people. Return the pendant to its rightful place in the heart of the Verdant Expanse, and seek the guidance of the ancient tree spirits to restore harmony. In doing so, you will not only avert disaster but also earn the eternal gratitude of Elvenwood. Will you accept this quest?" ###Grimgar: Well I would, but I already sold it to the dwarf in the shop ***Dungeon Master:
Has anyone else experience anything similar? My product will be pretty much unusable after 0603 is sunset if this is going to be the future of 3.5.