Increasing the limit of max_rerank for the search endpoint

Hey!

I’ve been working with the search endpoint the past few days and was wondering if I can increase the limit of max_rerank from 200 to “all the possible matches found”?

For example, I have 1000 documents and for a given keyword there are 400 matches. With this endpoint, I’m only able to get 200 documents. I’d like to get 400 matches as my output as opposed to the 200 documents.

1 Like

The current technique people use is to shard the dataset into n=200 pieces, and then use the winners from those to do a final search (or in your case, just take the top 80 from each set [80 * 5 = 400])

3 Likes

@bram Sounds good! Thanks for the suggestion :slight_smile: