# Gpt-4-1106-preview: 400 This model's maximum context length is 4097 tokens **URL:** \ **Category:** API\ **Tags:** api, token, gpt-4-turbo\ **Created:** [January 3, 2024, 2:05pm UTC](https://community.openai.com/t/gpt-4-1106-preview-400-this-models-maximum-context-length-is-4097-tokens/578172 "2024-01-03T14:05:19Z")\ **Posts on this page:** 9\ **Page:** 1
**Author:** ![SoftTimur](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/softtimur/32/7727_2.png) [@SoftTimur](https://community.openai.com/u/SoftTimur)\ **Post date:** [January 3, 2024, 2:05pm UTC](https://community.openai.com/t/gpt-4-1106-preview-400-this-models-maximum-context-length-is-4097-tokens/578172/1 "2024-01-03T14:05:19Z")
Hello, We have a web application which calls `gpt-4-1106-preview` with `stream: true` in the backend. For instance, ```auto const input = { model: "gpt-4-1106-preview", messages: [{ role: 'user', content: "I have a long text to show you..." }], stream: true, } const stream = await openai.chat.completions.create(input); ``` We often receive error messages like `400 This model's maximum context length is 4097 tokens. However, your messages resulted in 16727 tokens. Please reduce the length of the messages.` But should not `gpt-4-1106-preview` accept 128k context lengths? Does anyone know how we could increase the maximum context length and avoid the 400 error? Thank you ---
**Author:** ![\_j](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/_j/32/766292_2.png) [@\_j](https://community.openai.com/u/_j)\ **Post date:** [January 3, 2024, 2:27pm UTC](https://community.openai.com/t/gpt-4-1106-preview-400-this-models-maximum-context-length-is-4097-tokens/578172/2 "2024-01-03T14:27:19Z")
If you are indeed specifying the correct AI model, this may be a case of an incorrect error message evoked by specifying exactly the wrong value of parameter. I would look first at `max_tokens` that you are using. That is the response length reservation in tokens. It is NOT telling the AI its own context window. A good maximum is about 1500 tokens, the most you will get out of the model unless doing specific data processing tasks. The maximum output this AI model can be set to is 4k. ---
**Author:** ![SoftTimur](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/softtimur/32/7727_2.png) [@SoftTimur](https://community.openai.com/u/SoftTimur)\ **Post date:** [January 3, 2024, 2:38pm UTC](https://community.openai.com/t/gpt-4-1106-preview-400-this-models-maximum-context-length-is-4097-tokens/578172/3 "2024-01-03T14:38:52Z")
I just added some code to the OP. Usually I didn’t specify `max_tokens`. I would like my backend to be able to accept long requests. Do you know what’s the maximum context length that `gpt-4-1106-preview` can accept? ---
**Author:** ![\_j](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/_j/32/766292_2.png) [@\_j](https://community.openai.com/u/_j)\ **Post date:** [January 3, 2024, 4:27pm UTC](https://community.openai.com/t/gpt-4-1106-preview-400-this-models-maximum-context-length-is-4097-tokens/578172/4 "2024-01-03T16:27:05Z")
`gpt-4-1106-preview` has a context length of 128000 tokens, technically 125k. $1.25 + $0.09 for some output. calculator: [https://tiktokenizer.vercel.app/](https://tiktokenizer.vercel.app/) ---
**Author:** ![SoftTimur](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/softtimur/32/7727_2.png) [@SoftTimur](https://community.openai.com/u/SoftTimur)\ **Post date:** [January 3, 2024, 4:49pm UTC](https://community.openai.com/t/gpt-4-1106-preview-400-this-models-maximum-context-length-is-4097-tokens/578172/5 "2024-01-03T16:49:41Z")
So what should i do to avoid such 400 errors? If I set for instance `max_tokens: 8192`, we will have less 400 errors than before? Thank you ---
**Author:** ![\_j](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/_j/32/766292_2.png) [@\_j](https://community.openai.com/u/_j)\ **Post date:** [January 3, 2024, 5:03pm UTC](https://community.openai.com/t/gpt-4-1106-preview-400-this-models-maximum-context-length-is-4097-tokens/578172/6 "2024-01-03T17:03:30Z")
As described earlier, you cannot set `max_tokens` above 4000, the maximum output this AI model allows, despite its input context length. See above where it says “a good maximum” ---
**Author:** ![raulblanko](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/raulblanko/32/137983_2.png) [@raulblanko](https://community.openai.com/u/raulblanko)\ **Post date:** [March 18, 2024, 5:57pm UTC](https://community.openai.com/t/gpt-4-1106-preview-400-this-models-maximum-context-length-is-4097-tokens/578172/7 "2024-03-18T17:57:07Z")
Could I ask you if you found the solution how to deal with very long prompts and this model? ---
**Author:** ![\_j](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/_j/32/766292_2.png) [@\_j](https://community.openai.com/u/_j)\ **Post date:** [March 18, 2024, 6:18pm UTC](https://community.openai.com/t/gpt-4-1106-preview-400-this-models-maximum-context-length-is-4097-tokens/578172/8 "2024-03-18T18:18:51Z")
> [@raulblanko](#): > > how to deal with very long prompts and this model You can send VERY large $1 inputs to the model no problem. The issue that was faced was not understanding that: - the `max_tokens` setting is only for the size of the **response** ; it doesn’t correspond to the total context length of the model that you want to use or relate to what you send (except for subtracting from the available space); - the gpt-4-turbo models have an artificial limitation of 4k maximum output despite their large context that would make one think they could produce longer answers. Solution: - Ask for a reasonable max\_tokens like 2000 - that prevents billing overages if the model goes crazy. - Send up to 126000 tokens of input - if you want to pay for it - and hope the AI can pay attention to all of it at once. ---
**Author:** ![sps](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/sps/32/7736_2.png) [@sps](https://community.openai.com/u/sps)\ **Post date:** [March 18, 2024, 6:59pm UTC](https://community.openai.com/t/gpt-4-1106-preview-400-this-models-maximum-context-length-is-4097-tokens/578172/9 "2024-03-18T18:59:59Z")
Is this the exact code resulting in the error apart from the message placeholder? Are you specifying `max_tokens` in the requests that result in this error?