Langchain AzureOpenAI works for gpt 3.5

I instantiated a chain as below

load_qa_chain(AzureOpenAI(deployment_name=‘gptturbo’),chain_type=“stuff”,prompt=PROMPT)

I thought this will give me an error as GPT is a chat model and not a completion one. But it did not. Can anyone please tell me why it is not failing? The chat and completion APIs, I thought are not compatible

gpt-35-turbo is the only model in Azure Open AI that supports both Chat and Completion. You are able to select it in both the Chat and Completion tab in the Azure Open AI workspace. When using gpt-35-turbo from Python for completion I did have to create a custom wrapper because this API does not take the best_of parameter. gpt-review/_llama_index.py at 21249fc5257dc69feb05aa0f929e9f226e56d74c · microsoft/gpt-review · GitHub

1 Like