Hello, i have a startup witch is basically a chatgpt wrapper and a very clever system-prompt The problem is that for each user-request i use the same system-prompt which is 1500 input tokens and more 500 to 1000 tokens that are inputs from my user that changes(therefore cannot be cached) There is …

gpt-4o currently points the latest 4o model gpt-4o-2024-08-06 which supports prompt caching.

Prompt caching not working

jrabelo November 2, 2024, 7:02pm 2

for some reason nothing is being cached

Topic		Replies	Views
Does prompt caching works on chatgpt-4o-latest? Prompting gpt-4 , chatgpt	5	583	December 10, 2024
Prompt caching with multiple agents API	1	515	October 9, 2024
Why don't we have prompt caching on gpt-4? Feedback gpt-4 , prompt-caching	1	109	November 22, 2024
How Prompt caching works? API assistants-api , prompt-caching	17	5583	February 4, 2025
Prompt Caching for o3-mini? API o3-mini	3	444	February 4, 2025