Metadata of responses api

If you click into a conversation in the responses logs, and expand, you’ll see that there is indeed “tokens” shown for each message. It is tedious to get to, and you can’t see them in aggregate, but token consumption is there, which can be translated to monetary costs.

It also doesn’t seem to be foolproof, and any error like I just discover on one stored “responses” (where others running similar calls have token values) means the whole site cannot be trusted to deliver accuracy.

“Usage” in the dashboard allows you to download a block of API calls, regardless of whether they were stored by Responses, but that also is not as versatile as one might wish. Also not trustworthy to deliver on its promises, because instead of being able to demonstrate the quality of data there, I can only demonstrate a spinning icon of never being able to download.

1 Like