Some users of my simple-openai library are reporting that they have started having problems with the ranking_options.ranker field of the file_search tool:
When calling the POST https://api.openai.com/v1/threads/{thread_id}/runs service, they are receiving, as part of the thread.run.step.delta event, an undocumented value: default-2024-08-21 (with dashes):
2025-03-05 22:02:32 INFO URL: https://api.openai.com/v1/threads/thread_tfhxTgLD3g1DOLoKJ8NPQIfU/runs
2025-03-05 22:02:32 INFO Request Body: {"assistant_id":"asst_3EXQS7BoLze8wj6aT5bZQ3Lu","stream":true,"parallel_tool_calls":false}
2025-03-05 22:02:47 INFO Response Body:
event: thread.run.step.delta
data: {"id":"step_15n2yP0vTPEs2vxCc1ar6LUM","object":"thread.run.step.delta","delta":{"step_details":{"type":"tool_calls","tool_calls":[{"index":0,"id":"call_PdjWRYNa6h5fwFUHDJZKmody","type":"file_search","file_search":{"ranking_options":{"ranker":"default-2024-08-21","score_threshold":0.0},"results":[]}}]}}}
According to the OpenAI API specification, the expected value is: default_2024_08_21 (with underscores).
It seems that assistants created from the OpenAI web interface are the ones that have the problem.
OpenAI Staff, could you please take action on this problem?
From my library I had to implement a makeshift solution for this OpenAI bug, so at this point I don’t know if it still persists.
This is not the first time my users have detected this kind of problems from OpenAI, for example you can take a look at Receiving an unknown tool "browser"
IMHO, OpenAI needs to improve the management of its API. If there is an API specification, OpenAI should adhere to it.
As users of the OpenAI API we ask for just a little respect.