I would like to utilize Open AI Batch API as it helps reduce the cost by 50%. I have been using Open AI models through LangChain and I have been trying to find some information on how to incorporate the Open AI’s Batch API but I found no helpful information on it. Does LangChain even support Batch API?
Technically you could iterate each step of LangChain using the Batch API, but out-of-box no you can’t