Responses: Send tools again with prior response id?

API Bugs
1

I am expecting to not have to send the tools again if I am references a prior Response ID that had tools.

This has the tools on every Request. Note that requests take up to a minute this way.

This image shows a trace of an "Agent Workflow" with the breakdown of steps, durations, and corresponding progress bars for each sub-operation, highlighting the total time taken by the MCP Agent as well as the individual API calls and tasks. (Captioned by AI)
This image shows a trace of an "Agent Workflow" with the breakdown of steps, durations, and corresponding progress bars for each sub-operation, highlighting the total time taken by the MCP Agent as well as the individual API calls and tasks. (Captioned by AI)2440×696 59.6 KB

Answer is perfect:

The image shows a chat interface where a user asks for the weather forecast for Kittsee, Austria, and the assistant provides a detailed weather preview for the next day, including condition, temperature, precipitation chance, and wind speed. (Captioned by AI)
The image shows a chat interface where a user asks for the weather forecast for Kittsee, Austria, and the assistant provides a detailed weather preview for the next day, including condition, temperature, precipitation chance, and wind speed. (Captioned by AI)996×2192 299 KB

This has the tools only on the first Request. Now it doesn’t know on the second request that there’s a weather forecast tool!

This image shows a trace of the "Agent Workflow," detailing the execution times of various steps including "MCP Agent," "List MCP Tools," multiple "POST /v1/responses," and "geocodeAddress" in a hierarchical timeline format. (Captioned by AI)
This image shows a trace of the "Agent Workflow," detailing the execution times of various steps including "MCP Agent," "List MCP Tools," multiple "POST /v1/responses," and "geocodeAddress" in a hierarchical timeline format. (Captioned by AI)2442×526 44.9 KB

And it starts to hallucinate:

The image shows a chat interface where a user requests a weather preview for Kittsee, Austria, and the assistant confirms locating Kittsee, then repeatedly states it will fetch the requested weather forecast for tomorrow. (Captioned by AI)
The image shows a chat interface where a user requests a weather preview for Kittsee, Austria, and the assistant confirms locating Kittsee, then repeatedly states it will fetch the requested weather forecast for tomorrow. (Captioned by AI)978×1750 113 KB

Feature request! Cache tool schema info together with the Response!

1 Like