Extending Tool Call Functionality


Not sure if this is the right place to go with this but here goes. The “tool_call” (used to be “function_call”) parameter in the chat completion endpoint is call but I think it would be extra useful if the functionality could be extended slightly.

Currently, you can enforce a specific tool, enforce no tool or let it choose whatever. The one thing that is missing is the ability to enforce a tool call but not specify which one. This would be very powerful when you need the LLMto provide structured inputs and outputs but want to allow it to choose the tools it uses.

If anyone knows a better place to go with this request please let me know.

I am not sure how the “tool_call” parameter works behind the scenes but I suspect this would be relatively easy. All that would need to happen is appending the start of a function call message up to just before the name before passing the message to the model I would imagine.