Microphone input and audio/media stream output support?

ChatGPT Apps SDK
1

Hi everyone,

I’m building a ChatGPT app with an Apps SDK widget, and I want to confirm the expected support for media I/O inside the widget.

This is not about using ChatGPT’s native Voice Mode or triggering MCP tools from Voice Mode. I’m considering implementing voice directly inside the widget:

  • capture microphone input with getUserMedia()
  • connect from the widget to my backend using WebRTC or WebSocket
  • receive and play back audio/media streams inside the widget

Questions:

  1. Is microphone/media capture inside an Apps SDK widget officially supported or allowed if the user grants permission?
  2. Is audio playback or WebRTC media output expected to work inside the widget iframe?
  3. Are there known limitations or bugs on ChatGPT native mobile apps, especially iOS/Android, compared with ChatGPT web/desktop?
  4. If this is allowed, are there recommended CSP, permission, or implementation patterns for this use case?

Thanks!

1 Like