How to reduce token usage by repeating system prompt each time for batch API

This may be what you are looking for;

https://platform.openai.com/docs/guides/prompt-caching

Relevant thread in the community:

3 Likes