Anyone using OpenAI Realtime API with ElevenLabs voices?

API
1

I’m exploring the OpenAI Realtime API for transcription and was wondering if anyone has managed to integrate it with ElevenLabs voices.

My goal is to get a live transcription from OpenAI and then use ElevenLabs to convert that text back into a natural-sounding voice in real time.

6 Likes
2

Also interested in this. Have you found a solution?

3

I cannot see a limitation here?

You can sign up for Elevenlabs API:

I have been really enjoying their voices in their reader app.

1 Like
4

Some one did API real time + elevens labs voice for beeing more human ? i need please

5

yes, I also want this demo：） do u have any advices?

6

Just curious, if you like eleven labs voices, why not just use their agents? Why mix in the realtime API?

7

You can use their conversational AI. It is pretty much the same thing as the Realtime API with the only difference being that OpenAI Realtime API uses Audio to Audio models and ElevenLabs uses Speech to Text to Text to Speech.

The latency is not noticable if configured right.

Cheers. :hugs:

8

hi @j.wischnat

thanks for you anwser

But we sell it in french, are you thinking it is good even in french ?

1 Like
9

Yes, they have multilingual models. I’m German and we have a voice-assistant in German, working perfectly fine.
French is supported. :hugs: