We’re getting frequent 500 errors from the vectorstore.files.list API, typically when calling getNextPage(). We are using the npm library which does retries by default, but this doesn’t appear to help. Our vectorstores typically contain thousands or even 10s of thousands of files.
Has anyone else been experiencing problems listing files?
Hi!
Are you still experiencing this issue? I haven’t seen any other reports, so it may be that you are pushing the system to its limits, or it was a temporary hiccup.
In the meantime, I tried to reproduce the problem using a vector store with a very large number of attached files, but I was not able to trigger a 500 error. Also, the types of errors we have seen previously with the results pagination did not appear during my testing.
If this is still ongoing for you, please share a few request IDs so staff has a better way to identify the root cause.
After working with OpenAI support I was able to create a simple shell script that reproduces the problem. The problem itself, however, is probably rare – because it was likely aggravated by a bug in our own system which caused a large number of duplicate files to be uploaded and then those duplicates were deleted. Having a large number of deleted files in the vector store then led to problems when trying to list all files. The case is still open with the OpenAI support guys.
Hey @kduffie, Since you already have a request open with our support team. We will close this thread to avoid any duplication. Thank you for flagging it with us.