Is there any way I can get openAI like batch API support for open-source models like llama-3.1-70b, codellama-70b-instruct etc where I can also get cheap pricing also maybe 50% off like openAI.
1 Like
EXXA co-founder here. At EXXA (withexxadotcom) we have precisely built a batch API for open-source models, offering the lowest price per token with a 24h delay. Let me know if you need a specific model that is not currently supported.