Assistants API too slow for realtime/production?

There’s a slight bit of diagnosis available - not that it will get the answer you paid for though.

https://platform.openai.com/docs/api-reference/runs/listRunSteps

You can see if the AI was doing things other than just generating an answer.

2 Likes