Reading through all the docs and trying to get up-to-date, I’m really loving the new Logs and their listing of retrieved files and scores - I remember in AssistantsAPI you could set a score_threshold - but is that not a thing with the built-in-tools for Responses?
Just following-up. I see in the Response object we have this:
{
"type": "file_search",
"filters": null,
"max_num_results": 20,
"ranking_options": {
"ranker": "auto",
"score_threshold": 0.0
},
"vector_store_ids": [
"vs_2dksjdfokcnei"
]
},
and I can see filters and max_num_results referred to in the docs here: https://platform.openai.com/docs/guides/tools-file-search but don’t see mention of the ranking_options (guess I could just try it…)
I tried adding the ranking options to the tool when creating with Responses API.
{
...
"tools": [{
"type": "file_search",
"ranking_options": { "score_threshold": 0.6 },
"vector_store_ids": ["none-of-your-business-😉"]
}],
...
}
and the response comes back with the value that I passed:
{
"type": "file_search",
"filters": null,
"max_num_results": 20,
"ranking_options": {
"ranker": "auto",
"score_threshold": 0.6 # <- 🎉
},
"vector_store_ids": [
"none-of-your-business-😉"
]
},
However, the actual results scores are often be below the threshold, so I’m not sure if it’s actually being used yet. ![]()