Realtime API Pricing: VAD and Token Accumulation - A KILLER

[liquidshadowsmk]

This is an encouraging response from OpenAI Staff:

Thank you @jeffsharris

@jeffsharris

I’d love your org info if you’re seeing problems here (feel free to DM me)

One debug step that’s helpful to check is using the Playground, you can see the total tokens of each type consumed during your entire session at the top of the Logs

The way cost accumulate as sessions go on is a top priority for us to address at the moment. We’re underway adding caching so that we can heavily discount audio + text that’s been encountered already