Hi, Sometimes I am getting an empty response from the completion endpoint. The generated text is basically an empty string like: choices: [ { text: ‘’, index: 0, logprobs: null, finish_reason: ‘stop’ } ] This happened with curie and DaVinci. Anyone facing the same issue?

What’s your prompt look like? Is it short? Changing that up might make it more stable … I’ve noticed that sometimes even in Playground it won’t know what to say. Usually changing temp or another setting fixes it, but you might check your prompt too. Hope that helps.

Thank you @PaulBellow The prompt is about 960 tokens. It is working fine from the playground but when I call the API directly from my code, it will start returning empty strings after 4 to 5 calls.

Interesting. I have tried the same prompt in the playground 10 times and didn’t have any issues. Then I made the same call from Postman 10 times again on both engines and all of them returned proper response. The problem only occurs when I make the call from my app! I will keep debugging to identi…

No problem. Are you using a stop-token in your app’s call to the API? Is the prompt in the app maybe adding a space to the end? A space at the end of the prompt can throw it off sometimes. Good luck!

I found the issue, it was a \n at the end of the prompt text! You’re a legend @PaulBellow :beers:

Haha. Great! That reminds of this time at the newspaper back in the 90s… trying to get a legacy system info online. I spent about a day and a half … finally finding an INVISIBLE character at the end of the file… haha… oh, the memories. Glad you found it! There’s nothing like that feeling…

I’ve seen this behavior when getting it to generate dialogs. My impression was that I had constructed the prompt in such a way that GPT-3 found no viable answer. In the situation where I was getting blank dialog but with labels for each speaker, stray characters at the end of the prompt was not the …

I have the same problem here, the promo working well on the playground, then copying the code from the playground to Postman with exactly the same, but it returns empty text. On playground: [image] On Postman: { “model”: “text-davinci-insert-002”, “prompt”: "The sizes of LED screens are custo…

Empty text in the response from the API after few calls

API

PaulBellow May 6, 2021, 9:47pm 4

Does it do the same in the playground after 4 or 5 tries? Might be your filter setting in the production app?

Topic		Replies	Views
API is returning empty text on random Prompting	6	3955	August 9, 2021
Api call return empty, but works in playground Prompting	6	3530	May 20, 2023
Getting a blank response Prompting	9	4027	June 10, 2021
API completion for small questions are random code Prompting	12	1669	January 11, 2023
Why does the ChatGPT API return empty results when using certain types of prompts in Python? API	30	9925	March 17, 2023

Empty text in the response from the API after few calls

Related topics