Connecting Gmail and Calendar MCP to gpt-realtime

GPT builders
1

Hi Everyone, I am trying to use realtime audio to create an assistant that can send myself email reminders and book timeslots in my google calendar. I have connected the Gmail and Calendar Tools with OpenAI’s built-in MCP, however, during setup I immediately get an error. I have attached the part that is causing issues:

session.tools:array[2]

Error Message on start up:

type:"error"
event_id:"event_CPmIQwl2XNdQShI1JoMye"
error.type:"invalid_request_error"
error.code:"unknown_parameter"
error.message:"Unknown parameter: 'session.tools[0].server_description'."
error.param:"session.tools[0].server_description"
error.event_id:null

I’m new to building AI agents and despite currently being a software engineer with a computer engineering degree, I never learned this stuff in school :sweat_smile: Please be easy on me, I’m a beginner. Any assistance is greatly appreciated.

1 Like
2

If you were using Realtime API, I assume it’s using a different schema, which accepts a smaller set of MCP/tools keys in comparison to Responses API.
I guess you can provide your MCP server description via system message if needed.

Or am I wrong? I ran into the same issue, and that’s the only solution I’ve found.