Thank you for your response, really appreciate it.
I’m using function calling and one of the main properties of the object is an array. I need the number of items to be specific. I was trying to use the minItems and maxItems properties as well as specifying in the prompt the number of items I wanted. Before reading this topic How to make function calling return array as long as I want? I thought that the reason for the API not returning more items was the number of tokens, but it turns out specifying minItems isn’t that effective…
After specifying in the items description the number of items I managed to get more responses with more tokens and the correct number of items.
Thank you for clarifying how these limits on the number of tokens work. Now I understand that I can indeed receive an output of 4000 while also providing a prompt of 3000 for example (so long as the total context is under 16,000).
1 Like