Getting around "max_tokens"

[SecMovPuz]

There is no way to increase max tokens but here are some posts about creating longer completions.

Practical Tips for Dealing with Large Documents (>2048 tokens)

What are some practical approaches for dealing with large documents that exceed the 2000/2048 token limit? Use cases include summarizing / classifying large and complex documents, e.g., scientific articles, legal filings, financial disclosures. Would the standard approach be to divide into paragraphs, and then feed those in individually? Or is GPT just not suited for long documents yet?

Suppose I want to write a story which is longer than 4000 tokens

Welcome to the OpenAI community @lordjoe It is not possible to exceed the token limit of an engine. However there are ways to get the desired length explicitly, using multiple calls to the API. Firstly, if the desired length of completion is under the limits but the original completion isn’t what you want, you’ll have to redesign your prompt and be very specific of what you want from the engine. E.g. "Write an article about unicorns." → "Write an article about unicorns in 100 words." You can…

Best way to create responses that exceed token length

I am trying to code a tool to be used to generate “short” stories that will exceed the token limit. I have seen some interesting comments about summarizing the previous sections but I am having trouble making gpt-3 generate responses that easily can be joined together. Any suggestions about joining two generated sections or a better method for generating long responses would be greatly appreciated.

Also based on what your saying it seems like you dont need 2048 tokens so maybe just decrease it past what your prompt will be?