JSON Mode with GPT-4 turbo stops after 1050 token

[_j]

Here’s an idea of what’s going on internally:

Function Calling parameter types

However, in general, one must write their own function, with JSON data types. string number boolean null/empty object array Lets look at a demonstration of them all, how you would specify them as a “functions” API parameter; how the specification is rewritten into AI language by the endpoint; how the AI calls the function as it is specified. Function specification sent to API functions = [ { "name": "data_demonstration", "description": "This is the main function description", "…

The language the AI emits can’t be emulated as AI input, as you can’t wedge yourself into that part of the ChatML token container. “Exploit” would be just calling a function, which the AI already does. The AI essentially emits a to=function.function_name, a message that is addressed to a “recipient”, which recognizes and accepts the AI output (json typical unless you make your own uncharted rules) and gives you the function_call AI language you receive by API.