When using WebSocket to call the Realtime API, how long does the server cache the context? Is there also a limit on the number of cached tokens?
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Realtime History - keep the context not ask the same questions | 0 | 96 | January 2, 2025 | |
Context Limitations in Real-Time API | 0 | 102 | February 9, 2025 | |
How does prompt caching affect d TPD limit | 2 | 73 | October 29, 2024 | |
Realtime API costs per ephemeral key | 1 | 94 | January 27, 2025 | |
Realtime API and session costs | 2 | 371 | November 4, 2024 |