Is there any way I can get openAI like batch API support for open-source models like llama-3.1-70b, codellama-70b-instruct etc where I can also get cheap pricing also maybe 50% off like openAI.
Related Topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| BatchAPI is now available | 88 | 13657 | July 24, 2024 | |
| Query api models and pricing alternatives | 0 | 23 | August 20, 2024 | |
| Querying different models via single batch request | 0 | 219 | November 16, 2023 | |
| Can GPT-4o models use Batch API prices? | 1 | 211 | July 8, 2024 | |
| Is there a way to give others access to a fine tuned model I made? | 1 | 79 | August 3, 2024 |