AMA on the 17th of December with OpenAI's API Team: Post Your Questions Here

Nothing to share just yet. We focused the first pass of prompt caching on making it as easy as possible to use (no API changes needed, no extra cost for cache writes). It’s a feature we care a lot about though … would be curious how you’d want to use a more structured cache?

3 Likes