I am trying to use the ChatGPT API. All my prompts work fine except my longest prompt. When I use this prompt no response is sent for a few minutes and then I get an error with a HTML page which’s title is ‘504 Gateway Time-out’ and in the body it says ‘nginx’
I’m unfamiliar with this system, perhaps they have a community you can reach out to for help? This might be a problem specific to the platform you’re using
Do you perhaps know how long the prompt was? You can use tiktoken or alike to get the close estimate to the number of tokens but I am also fine with number of characters. I’m encountering a similar issue and want to see if it is also related to the length of the prompt or something else.