I missed the announcement, I think, but it appears you can now use a total of 4,000 tokens - split evenly between prompt and output. This should help chat bots and some other applications. Thanks to the OpenAI team! Keep it up!

New 4,000 token context window (prompt+output)

PaulBellow March 17, 2022, 8:47pm 2

tokens

2 Likes

Provide technical updates via email listserv (or something)

Topic		Replies	Views
Is the "output (Maximum length)" for the GPT-4-1106-preview API still capped at 4095? API gpt-4 , gpt-4-turbo	3	5221	November 15, 2023
Why is gpt-3.5-turbo-1106 max_tokens limited to 4096? API	3	9147	January 11, 2024
Test new 128k window on gpt-4-1106-preview API	29	13962	February 6, 2024
GPT 4 Turbo is limited to 4K? API gpt-4	16	8414	April 9, 2024
Since the token limit is 4096 for GPT4, how does 8k and 32k model make a difference? API	4	1370	December 15, 2023