So I’ve deployed GPT-4 with 50k TPM, GPT 3.5 Turbo 16k with 120k TPM and GPT-4 Turbo preview with 80k TPM in Azure OpenAI. I’ve set max_tokens=-1. My solution follows RAG with it retrieving multiple chunks of documents based on the given prompt. When I chat on this and ask the model to list all the …

Response being cut off in Azure OpenAI

akashnair1307 January 29, 2024, 4:36pm 5

I’m using Cognitive Search with the help of LangChain. I’ve also tried FAISS

Topic		Replies	Views
Trouble extracting all information from long context document API gpt-4	6	1223	October 29, 2024
I don't get the full result no matter what I do API api	6	2960	September 1, 2023
Openai web search token limit issue Bugs	4	119	March 25, 2025
GPT4 Limiting Examples Cited in RAG Q&A API gpt-4 , api	2	1093	October 27, 2023
OpenAI truncating the response API gpt-4 , chatgpt	0	110	April 4, 2025