How can I implement batch processing for my workflow, which involves a complex process?
Currently, each API request includes a user prompt text that is about 6,000 tokens in size, along with a scanned image of the document to be processed.
To maintain high resolution, since the API significantly reduces the size and quality of the attached image, we started splitting the image into tiles. This approach has been working well.
Now, for each request, we include 20 to 40 tiles. Is it possible to batch process these requests, ensuring that each item in the batch uses a unique set of tiles?