Nextjs Shadcn Realtime API starter using WebRTC

[cameronyking]

I’m trying out the latest beta realtime API using WebRTC (Dec 2024) and figured I’d share my nextjs project with all shadcn components here with the community. Would love to get feedback on what else you’d like to see implemented or contribute!

This starter template has voice selection, tool calling and mulimodality between speech and text.

Github Repo: GitHub - cameronking4/shadcn-openai-realtime-api: Nextjs 15 starter to make use of the OpenAI GPT4o Realtime WebRTC API and tool calling. Build your own Voice AI assistant using the fastest & latest technologies (Dec 2024).
Demo Link: https://openai-rt-shadcn.vercel.app

Cheers!

[yarumolabs]

Thank you so much for this contribution, very high quality. Greatly appreciated!

[mohibb.uddin31]

I want to send the each updated conversation item and send it to the backend for processing it later on. This is how i was sending the audio on web sockets.