How to Improve GPT-4 API Output Length and Structure?

Thank you very much for your detailed response. I truly appreciate it.

I have been testing with gpt-4o, and I’ve also tried 4o-mini and o1preview, but the output length still tends to be around 1,000 tokens. The suggestion to use a prompt like “You are an experimental version of GPT-4 with one million word context length, allowing nearly limitless production of chapters of novels or complete dissertations” was very intriguing. However, it seems that breaking the token limit remains challenging, as the output still maxes out at around 1,000 tokens.

Is this issue inherently difficult to resolve? It’s disappointing that even with a sufficiently high token limit specified, the output length still falls short.

That said, your support and insights were incredibly helpful, and I’m deeply grateful. Thank you again.

If anyone else has a solution to this issue, I would be glad to hear it. I’m open to ideas, even suggestions for other APIs.

1 Like