I’m developing a FastAPI application where I’m using WebSockets to send text deltas from an Assistant’s API event handler in real-time. However, the tasks responsible for sending these deltas remain in the PENDING state and never run. As a result, the client doesn’t receive the expected data. Sympt…

I’ve confirmed that the issue is due to not using the async client. I changed my event_handler to use AsyncAssistantEventHandler: from openai import AsyncAssistantEventHandler In my main.py file I added an async client for the async streaming calls AsyncOpenAI. from openai import AsyncOpenAI No…

do you have some kind of flush() function in the stack your are using? like if you need to send some text chunks to the client, you call the flush function.

I don’t think there’s a need to .flush() anything. Typically in a WebSocket implementation, you would ensure the event loop is running correctly and that you’re awaiting the WebSocket send operations directly to ensure they execute. For instance, using await websocket.send_json(data) directly withi…

Perhaps a better question here is, is there a better way for me to get the tokens to the front end other than websockets? My main constraint is that I don’t want to poll the thread directly in the client.

As I understand it, the point of the EventHandler is to be used to adapt to custom application logic. Please feel free to correct me if I’m mistaken. Rather than to merely print the text deltas to the terminal or log, I want to send them to my client. Currently, i’ve attempted to implement that u…

Perhaps its something to do with the type of client I’m using? The folks at chainlit have created this: Chainlit/cookbook/blob/c78495ba98d3f0eb74e5ecbce1e6554b520f6752/openai-assistant-v2-code-interpreter/app.py#L12 import chainlit as cl import asyncio …

I’ll add that my question about overrides was misguided. The @override decorator threw me off. Apparently it’s new in python 3.12, and will warn you if you slightly misspell something you are trying to override. I’m going to try your async solution real quick before I move on. I had ended up solvin…

Hey Karl, I am running into some similar issues. Any chance you would be willing to take a look and lmk if you see the cause of my error in the post on my profile?

Using Streaming Assistants API With Websockets

API

GoldenJoe July 25, 2024, 4:06pm 5

Why are you overriding the events in EventHandler?

Streaming markdown text and images from assistant using code interpreter

Topic		Replies	Views
Streaming is now available in the Assistants API! API api , assistants , assistants-api , assistants-streaming	54	28300	September 20, 2024
Error trying to stream Assistant API with websocket API api , assistants-api	2	502	January 28, 2025
How to stream with the Assistant API and a Flask endpoint? API python , assistants-api	5	1310	July 26, 2024
Streaming markdown text and images from assistant using code interpreter API	11	2723	January 30, 2025
Displaying assistant api on frontend - Websockets needed? API assistants-api	17	3039	April 1, 2024

Using Streaming Assistants API With Websockets

Related topics