Thats great if its appropriate for your applications.
Most of the projects we’ve worked on are mobile and distributed.
They also use the streamed response mechanism that doesnt provide the cost information.
Clients who use the applications are also not interested in having their requests go through some API gateway I operate.
The OpenAI system lets developers maintain multiple keys. We can even name them, and see when they were last used. It seems like a reasonable request to be able to see the accounting for how much each key was used in a billing cycle.
1 Like
Personally, I would rather handle the billing / usage on my end and let them concentrate on bigger / better models rather than trying to build out infrastructure for payments. That said, we might see it in the future? Although I bet it would show up on Azure first…
3 Likes
For clients applications you can’t just use the clients key?
If your client doesn’t trust you, I don’t understand why they are your client.
For streamed response you still get a reponse that can be run through tiktoken.
That should at least give you a pretty good estimate.
same question here, vote for this new feature in future update.
Commenting to vote for this too.
It’s obviously possible to track this outside of openAI, but it’s clumsy and always includes some degree of inference. Should be available at the source - openAI Usage screen.
1 Like
