Retrieval of Thread Message When Ready

isaac_attnis · November 14, 2023, 5:16pm

I have a paralegal chatbot built with Bubble io (no-code). I can create the thread, message, run it but I cannot set up a webhook in the Open AI platform to let my app know when the response is ready and finished to retrieve it. I set up a 20 sec delay but sometimes it is not enough and it retrieves the user prompt. Is there another way to fix it?

josh18 · November 14, 2023, 5:39pm

with assistants api you can query the status of the run and get the messages when the status shows completed. keep an eye out for other statuses that would indicate a non-successful termination.

DarthFader · November 15, 2023, 3:05am

You can see this code for how you could set up a “wait_for_run()” function:

github.com

langroid/langroid/blob/main/langroid/agent/openai_assistant.py#L487


      
                  self.process_citations(msg)
              return [
                  LLMMessage(
                      # TODO: could be image, deal with it later
                      content=m.content[0].text.value,  # type: ignore
                      role=m.role,
                  )
                  for m in thread_msgs
              ]
          
          def _wait_for_run(
              self,
              until_not: List[RunStatus] = [RunStatus.QUEUED, RunStatus.IN_PROGRESS],
              until: List[RunStatus] = [],
              timeout: int = 30,
          ) -> RunStatus:
              """
              Poll the run until it either:
              - EXITs the statuses specified in `until_not`, or
              - ENTERs the statuses specified in `until`, or
              """

(This is code for an Agent class that wraps the Assistant API in Langroid)

isaac_attnis · November 20, 2023, 2:16pm

Im going to try and incorporate something similar in no-code.

Thanks for the help!