Hey guys. I had developed a service and have been running it for a few months now. This service was made using FastAPI and openai 0.27.8 Python library.
The problem that I have is that the service gradually slows down almost regularly every 24 hours. When I restart it, it returns to normal speed.
Anyone else experience the same issue? What do you think could be the reason?
To give you a simple understanding, I have an agent class that is fully async and when a request is recieved at the endpoint, a new agent object is created I am using the openai chat async completions API.
Another issue is that while this was a problem that would appear every 24 hours in the old openai 0.27.8 library, in the new openai 1.2.3, it slow down occurs every 1 to 2 hours so I have not upgraded the service to the new library in production environment yet.