On the early days of open ai. (one year ago) an algorithm was shared to efficiently poll the information to check if the ai had the answers to whatever action you asked it to complete via functions.
The logic of the algorithm went something like a sliding window and a very useful snippet of code was made available for everyone
In fact it was best practice to use kinda sliding window algorithm so that open ai server could handle all requests
Where is that snippet of code! I needed