Unexpected Auto-Execution of Tools (maybe because of response_format: json)

API
4

I don’t see a schema provided - can you give an example of the type of answer you’d actually expect?

If I put myself in the shoes of the model, I’d see the following

  1. I have to respond with JSON
  2. the only schema provided is the function schema
  3. the user is asking me what I can do for the user
  4. I have to write "<|functioncall|>{"
  5. what’s next? I guess I can follow the function call schema
  6. "function":{"name":,
  7. ok, what can I do now? looks like “get_current_weather” is the only option
  8. "get_current_weather","arguments": "{
  9. What arguments? I guess the user told me to show them what I can do, I guess I’ll pick something random
    …
  10. now the function call is over, I guess I’ll close it
  11. “}}}”
  12. all braces are closed, what do I do now? well the object is closed, opening a new object wouldn’t be JSON compliant, so I guess the only thing I can do is send <|eom|>

and then the system comes in and breaks off the message.

I don’t see an opportunity for the model to provide a plaintext response :thinking: unless I’m missing something.