Issues hitting rates in playground & inconsistencies with vector search

I’ve been getting issues with hitting limits for the past 3 hours. Also had issues with accessing vector stores in playground. Haven’t changed anything from yesterday and running the same queries. Even a simple query and it gives me this:

Behaviour in playground goes between never-ending circling when trying to access vector, to providing a response ~25k tokens no problems, but then not being able to provide anything and hitting limits for similar queries that shouldn’t be hitting those limits.

I’m aware that OpenAi emailed: Erroneous usage data for some API users is leading to them incorrectly hitting usage limits

Incident resolved

This incident was resolved as of 6 pm PDT on 10/1/2024. Customers should no longer be seeing erroneous usage data or unexpectedly be hitting usage limits.

Time posted

Oct 2, 09:20 PDT

However, still getting issues and was curious to see others’ experience.

We are having the same problem…everything worked just fine before the incident and now we are constantly hitting the TPM limit without doing any changes to our prompts or codebase.

@27cb4d39bf9351227d9b do you still experience it or it was resolved in the meantime?

Unfortunately yes, still having the issue. It’s only 4o that has the issue and pretty sure it’s nothing on our end as the exact same queries submitted with 4o-mini are well below threshold limit of 30k that it seems to be having issue with.

Thank you for replying as I thought I was going mad :joy: and spent so many hours trying to troubleshoot what it could be.

Just got an email update from OpenAI:

Screenshot 2024-10-04 231618

Really pleased it’s being investigated at least! Thanks team OpenAI!

Hopefully will be up and running again soon but for now we are just using 4o-mini instead.

@georgeberar a solution has been implemented and OpenAI are monitoring the results.

We have full functionality of our vector stores and assistants api using 4o again! :tada:

Hopefully your issues have resolved as well.

Hi, I’m experiencing same problems with API and assistants, it’s been several days now. I get the same error of 30000 tokens :