Is there a method to view the usage log, such as the specific prompt that was passed? Although the Dashboard displays the tokens used, it doesn’t seem to show the actual prompt. Is there a way to access this information?
I saw someone showing prompt history from their API usage on the playground on YouTube, is this still possible? I see the history button in the playground, but I don’t see where I can access the history from the API usage.
Each time you make an API request, you should log parameters of the request (prompt, embeddings found, temperature, model name, …), and when you get an answer, log the result (status code, tokens consumed, etc.)
You can then take those logs into your log analytics system and build dashboards and such around them.
Here’s what I log (in go, using HTTP API):
“pq” is the prepared query; “gotnugs” are the retrieved embedding matches, idtok is the session ID, digest is the version of the prompt database.
You will note that I don’t log the prompt itself, but that’s stored in the conversation thread database if I need to look it up.