Function-calling (responses mode) – model says “Here is the document” but never includes it

API
18

So it’s fairly easy to prove this can work:

A screenshot of a prompt drafting interface in OpenAI's GPT platform, where the assistant humorously and with emojis retrieves and returns the exact text from a document after being requested by the user. (Captioned by AI)
A screenshot of a prompt drafting interface in OpenAI's GPT platform, where the assistant humorously and with emojis retrieves and returns the exact text from a document after being requested by the user. (Captioned by AI)1646×537 50.8 KB

The image shows a function definition editor with a JSON object that outlines a function named 'return_document', including its description, parameters, and strict mode settings, in a dark-themed interface. (Captioned by AI)
The image shows a function definition editor with a JSON object that outlines a function named 'return_document', including its description, parameters, and strict mode settings, in a dark-themed interface. (Captioned by AI)609×496 16.7 KB

  • calls function :white_check_mark:
  • text returned :white_check_mark:
  • assistant prints text to user :white_check_mark: (albeit with emoji’s as requested in system prompt :slight_smile: )

I’ve tried this with a much longer story and it worked too.

However, it is not reliable, and even with temperature set to 0.11 it sometimes doesn’t call the function.

You might want to experiment with different prompts and function descriptions to see if you can make it more reliable.