What is tool calling? Any information on that.
Used to be called function calling:
https://platform.openai.com/docs/assistants/tools/function-calling
It can be a bit confusing the first time you read that because can give you the impression that you actually need to code something.
You don’t. What you do is define a JSON schema for the response status.
e.g. you have your healthcare data in a PDF and the JSON schema basically says that the LLM will always return this structure:
- Name of the patient (string)
- Age (number)
- Cholestrol LDL level (number)
- Cholestrol LDL level status (enum [“optimal”, “near optimal”, “borderline high”, “high”, “very high”])
and so on.
You are basically giving the LLM the structure of the output and the machine tries to make the best decision to fill out the fields you have defined with the rules or restrictions you want.