Hi everybody,
I am sending in parallel requests to OpenAI, but I have faced a weird issue.
A couple of my requests never return, and keep spinning forever. When I would retry the exact same request, it works completly fine.
I am using langchain and I even added a timeout of 20 seconds but still weirdly enough it will not return. Any tips?
const model = new ChatOpenAI({
model: ‘gpt-4o-mini’,
temperature: 0,
apiKey: process.env.OPENAI_API_KEY,
maxRetries: 10,
// verbose: true,
timeout: 20000,
})
