Is there any way I can get openAI like batch API support for open-source models like llama-3.1-70b, codellama-70b-instruct etc where I can also get cheap pricing also maybe 50% off like openAI.
Related Topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
BatchAPI is now available | 88 | 13682 | July 24, 2024 | |
Query api models and pricing alternatives | 0 | 24 | August 20, 2024 | |
Querying different models via single batch request | 0 | 219 | November 16, 2023 | |
Can GPT-4o models use Batch API prices? | 1 | 213 | July 8, 2024 | |
Is there a way to give others access to a fine tuned model I made? | 1 | 81 | August 3, 2024 |