Vectorstores.list with second project returns 404

When using vectorstores.list via the API, or even using the OpenAI portal, I get a 404 error. “Vector store not found”. You can see this in the screenshot.

This works fine on our primary project and one of our secondary projects. But it doesn’t work on another one of our secondary projects.

You’ll note that the error message, “Vector store not found” is either a bug or may be a hint about the root cause.

2 Likes

Hi!

This looks like a small platform bug.

When you open a vector store in storage or vector stores, the browser URL updates with its ID. If you then switch to a different project, the URL still points to the old vector store ID, which triggers a “vector store not found” error.

Clicking any vector store in the newly selected project clears the issue.

I cannot reproduce anything similar with vectorstores.list via the API. There was a recent hiccup where the endpoint returned a 500 error, but that seems unrelated.

Misunderstanding, and it symptom: Vector stores are supposed to be newly-scoped to a project.

Is what is seen and then commented on true?

UI trace, with default project:

Clicking: dashboard, storage, vector stores.
Result: listing is loaded, the first list item is highlighted, written to the URL, shown in the right panel (expected behavior)

Perturbations: Switch “default project” drop-down to another project without vector stores?
Reproduction of: Significantly different symptom, with a call to action in the listing area instead of an error; the error is in the single vector store panel:

A direct URL click after the project choice is cookied: no errors at all:

https://platform.openai.com/storage/vector_stores/

Conclusion

  • You expect to use vector store IDs that you are paying for across projects.
  • OpenAI has purposefully broken this.
  • Result: You have to increase your daily billings.
  • Result: OpenAI doesn’t have to deliver more than a chunk hash to vector lookup in the backend to avoid any new embeddings calls, or even storage.

Justification

  • Projects divide rights to user data

Example:
You don’t want employees also asking about the bosses psych eval that he uploaded and asked about in his project vector store.

Fun:

Randomize chunk size and overlap on them with a bit of “jiggle”.

Resources are scoped to the projects where they were created, and only admin members can access them from outside that project.

Source:

Can resources be shared across projects?
Project resources (such as files, assistants, storage, or threads) are scoped to the project and cannot be accessed from non-admin members outside of the project. Furthermore, resources cannot be moved between projects.

1 Like

There is, indeed, a bug where the URL keeps the vector store from one project as you switch projects. But if I switch to “Files”, I can see all of the files for that project. But if I then toggle to “Vector stores”, it take about 30 seconds and then I get that “unexpected error occurred: Vector store not found” error again. There is no specific vector store ID in the URL at that point.

The error message hints to me that the bug here is that it is looking for a specific vector store for some reason. This happens consistently in my environment.

Saturday bug hunt? Why not. :slight_smile:

But, I can barely reproduce the issue right now, so a fix may already be rolling out.

When I switch projects the URL updates as expected and the first vector store loads with the correct URL. Because of this, I cannot recreate the behavior you described.

Please check whether the bug still persists on your side. Best case, it is already resolved.

Still the same. I have 3 projects. Two of them work and the third does not – neither in the UI nor via API. I am the owner of the whole thing so there’s no permissions issue. I’d guess that you can’t reproduce because there’s something messed up about my third project. I think we need OpenAI support to look at it.

Mod will note that a project that cannot have its vector stores listed in the platform site, nor by API call unless using a small API limit parameter or a different sort that avoids a corrupted list item, is exactly what I flagged for escalation earlier, and said, “can only get worse”…

1 Like

@kduffie

A few bugfixes have been rolled out since this topic has been created.
Do you still have this issue?

Just tested again in your portal. Still the same problems. First, we are unable to list vector stores on one of my 3 projects. Second, if you switch projects, you’ll get an error because it is still trying to find the selected vector store from the original project when you switch to the second project. Obviously the first problem is the main issue. The second one is just an annoyance.

1 Like

I can confirm this bug with the API as well – a GET request to /v1/vector_stores returns 404 with payload

{
  "error": {
    "message": "Vector store not found",
    "type": "invalid_request_error",
    "param": null,
    "code": null
  }
}

most of the time (about 90% of all requests).

The API key I use was created for a project.

Should be fixed now! We saw the issue on the vector store dashboard as well, deployed a fix, and is no longer seeing the error. The fix was not about vector store project scopes, but about some data drift related to vector store deletions. Can you go and try the vector store dashboard again to see if works?

2 Likes

Indeed, it is now working for me. Thanks!

1 Like

This topic was automatically closed 2 days after the last reply. New replies are no longer allowed.