SendFollowUpMessage - cannot be used reliably onSuccess of a tool call

I’m facing a use case that seems quite legitimate where:

  • The user clicks on a button that triggers a toolCall on my server (let’s say a search).
  • I want to send a follow up message to the model with a summary of the toolCall in the success callback of the toolCall.

I’m seeing this warning in chatGPT: “
main-DysC7zh_.js:2 Method `sendFollowUpMessage` called without synchronous user event”.

After a bit of digging, i can see that my sendFollowUpMessage is triggered only if it comes from a transient user activation Transient activation - Glossary | MDN which has a timeout of around 5 seconds.
So if my toolCall is <5seconds (difficult with some of the current latencies of chatGPT on toolCalls), my sendFollowUpMessage goes through, and if it’s >5 seconds, it gets blocked.

Just wanted to raise this issue, I feel like this conditional blocking of the sendFollowUpMessage is too restrictive as it sounds very natural to wakeUp chatGPT onSuccess of a toolCall triggered via the UI.

8 Likes

Minor: Make sure you are sending back correct toolcall call_id with the response.