Custom Assistants running slow

We created our own version of Assistants last month, you can create your own Assistant (Agent) and it uses 100% the “old API”

Yesterday we have migrated our backend to the new Assistants API (Beta) and while the result is always longer and more detailed, the latency is suuuuper slow, I mean like 15 to 25 seconds per run.

Using our original infra the same request takes 2-4 seconds.

is anyone else having this issue?

We have migrated over 100 agents recenlty, could that also throttle our runs?

3 Likes

I’m getting the same slow responses, half a minute for a reply