I am trying to use the chat completion API for a Very Large no of Inputs. Instead of calling the API N of times Can I use to bulk generate Answers by grouping multiple inputs so that the No of API calls can be minimized
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Mutiple text generation ( batch text generation ) single api call | 0 | 638 | August 30, 2021 | |
Batch requests with Chat Completion | 1 | 3485 | November 29, 2023 | |
Assistants API, Batch or Chat Completions? | 14 | 1838 | June 11, 2024 | |
Multiple messages per turn in Chat Completions API | 4 | 3494 | March 7, 2024 | |
Working with Batch API while keeping sessions | 1 | 325 | July 2, 2024 |