Assistant APIs is not responding, the run stuck in "in-progess" step

API
, ,
1

We deployed an application using Assistant APIs, but unfortunately, it’s not working from last week, anyone has any idea what could be the issue.

from openai import OpenAI
client = OpenAI()


agent= client.beta.assistants.retrieve("asst_id")

thread = client.beta.threads.create()

query= "recommend me some courses for improving my sleep"

message = client.beta.threads.messages.create(
    thread_id=thread.id,
    role="user",
    content=query
)

run = client.beta.threads.runs.create(
    thread_id=thread.id,
    assistant_id=agent.id
)

while True:
    run = client.beta.threads.runs.retrieve(thread_id=thread.id, run_id=run.id)

    if run.status == "completed":
        messages = client.beta.threads.messages.list(thread_id=thread.id)
        latest_message = messages.data[0]
        text = latest_message.content[0].text.value
        print(text)

the run status is “in-progress” for very long and response is not coming from the API, the same assistant works in Playground.

3

I am experiencing the same problem. Assistant API seems to be quite unreliable at the moment.

4

it seems to be completely broken right now, see the other thread active in the forum at the moment.

1 Like
5

The worst thing is when the status page says “All Systems Operational”, that hits the hardest! These guys are still in bed! Try to report the bug or problem through the help portal and I feel like that falls into a black hole .

4 Likes
6

This is still something we’re experiencing as well.

7

I am experiencing this as well. I believe it has something to do with SyncCursorPage when you call client.beta.threads.messages.list()

8

Hi @smbrandonjr

no, it’s not the case with client.beta.threads.messages.list(), we tried logger to identify the issue, it’s stuck in the run.status.

works perfectly in openAI playground

9

I have the same issue on my product. Assistants API is really dead now. Any runs finish for me - they got killed after 10 minutes of their server ‘thinking’.
It is really underwhelming that the OpenAI dev team ignores the claims

10

I’ve been trying to get any contact in OpenAI support team, we use an enterprise version and still there’s no support from them. we’re exploring Azure OpenAI services for now, and if the issue persists, we have to move on to another LLMs.

1 Like
11

We are thinking the same. If OpenAI cannot provide reliable services - then we need to find something more stable for the live product.

12

Write your own code to provide RAG and inner thought, and use the Chat completion API. Simples.

To be fair to Open AI, though, the Product is marked “Beta”, so really shouldn’t be considered for immediate rollout to Production until it exits Beta:

image

Its performance, cost efficiency and reliability need to improve.

What seems to have happened is everyone has piled in to use it without considering the state of the Product or its true viability.

1 Like
14

Hello, I have also been experiencing the same issue. Once every two weeks, the API gets stuck, and after a while (on average, 2 hours), it returns to normal. It’s a paid service, and I cannot understand why the free chat works fine while the paid service is unavailable. I am using python client API.