I was able to go up to 4000 tokens per prompt, for some reason I’m now limited to 2049 in davinci. This means rewriting an absolute ton of prompts I already had created. Why the sudden decrease?
Nevermind, it seems to have resolved itself for now. Not sure what happened.
Hey, Howard, I’m having the same issue on the playground page. I’m not using any long prompts, but I do add “Use max_tokens 3950” (minus the prompts tokens),it’s been giving me only a few paragraphs of 435 or fewer words. How did you fix your issue? Thanks