What’s your prompt look like? Is it short? Changing that up might make it more stable … I’ve noticed that sometimes even in Playground it won’t know what to say. Usually changing temp or another setting fixes it, but you might check your prompt too. Hope that helps.
Interesting. I have tried the same prompt in the playground 10 times and didn’t have any issues.
Then I made the same call from Postman 10 times again on both engines and all of them returned proper response.
The problem only occurs when I make the call from my app! I will keep debugging to identify the issue.
Haha. Great! That reminds of this time at the newspaper back in the 90s… trying to get a legacy system info online. I spent about a day and a half … finally finding an INVISIBLE character at the end of the file… haha… oh, the memories. Glad you found it! There’s nothing like that feeling…
I’ve seen this behavior when getting it to generate dialogs. My impression was that I had constructed the prompt in such a way that GPT-3 found no viable answer. In the situation where I was getting blank dialog but with labels for each speaker, stray characters at the end of the prompt was not the problem.
“prompt”: "The sizes of LED screens are customizable depending on your installation location and view distance from the target audience, such as a retail shop, “,
“suffix”: " a shopping mall hall, an airport departure/arrival hall, and so on…”,