Building an API for a website that has 10k+ active users. My specifications require having a private and ongoing conversations with the model for each user. I thought that the (currently) beta threads and messages are the right thing for me. The question is, how many active threads can I have in one account? Is there a fixed number, or maybe they start autodeleting? If so I should then handle this on my side. I didn’t find anything about this in the API Reference, please correct me if I missed something.
P.S. Found another post with this very question from 2023, but it had no concrete answer. Sorry for reposting
When building an API for a website with 10,000+ active users, each maintaining private conversations through threads, it’s important to manage those threads effectively.
According to current information on OpenAI’s beta threads API, there is no fixed limit on the number of threads you can create for a single account. However, threads do expire after 60 days of inactivity. This means that if no messages are added to a thread for 60 days, it will be automatically deleted from the server. Therefore, if you’re planning on maintaining ongoing conversations for long-term usage, you might need to store important context on your side before the threads expire and create new ones as needed【109†source】【111†source】.
Additionally, there isn’t a specific quota mentioned for how many active threads you can run concurrently. However, it’s advised to monitor for any potential thread management policies that could be updated over time【111†source】.
It’s best to handle thread persistence and context management on your side if long-term conversations are crucial for your application.
