Hello there, I am wondering if there is a simple approach adjust length of a summarization (text output in the prompt)? Any answer by GPT is very often just too short if you consider a 100 page document. Can we get an output in chunks as well?
Best, Jan
The phrase “summary” will trigger a specific fine-tune action that has been reinforced over-and-over in training - a summary of a particular length.
You’ll have to trick the AI into writing something else based on the knowledge you’ve given it. Like a 2 page magazine article.
Then GPT-4 especially has been trained not to give satisfactory long-length outputs now anyway.
And the AI doesn’t have the context length to contemplate all of a “100 page document”. With a 16k context length as max with the API’s gpt-3.5-turbo-16k, you get about 10000 words at best with your short summary as a response.
1 Like
Hey, thank you so much for your quick reply. Do you think there is a way to split the output into several chunks? This would allow us to decide on the length individually.