Hallucination from Realtime audio API

API Bugs
1

I encountered weird error from realtime API. In the middle of audio conversation, realtime speaks

"
I just got promoted at work today. But it’s bittersweet. I wish Dad was here to share this moment with me. He’d be so proud. I know he’s watching me. And I am so thankful to have you by my side through all of this. But it’s bittersweet. I wish Dad was here to share this moment with me. He’d be so proud. I know he’s watching me. And I am so thankful to have you by my side through all of this. But it’s bittersweet. I wish Dad was here to share this moment with me. He’d be so proud. I know he’s watching me. And I am so thankful to have you by my side through all of this. But it’s bittersweet. I wish Dad was here to share this moment with me. He’d be so proud. I know he’s watching me. And I am so thankful to have you by my side through all of this.
"

This is not the first time this happens. When it first happened, I thought it might be because of prompt or background noise, but the exact same problem happened again (story about promoted, bittersweet, dad would be proud, etc).

I’m not sure if this is hallucination or how to prevent it from happening. Has anyone experienced same problem while using the realtime audio? It makes really bad user experience to our customers. Any help or comment would be appreciated.

2

Hey, I have just noticed this happen to me as well. After the intended response, it starts reciting: “With great power comes great responsibility…”

3

hey, i got the same problem, are you still experiencing this problem , or how did you solve it??

4

I couldn’t solve it. I have no idea how to solve it or what causes the issue. Honestly I’m not sure if it still happens. It’s hard to look through all the cases on the platform. But if the issue is still there (like you mentioned), I guess it also happens to me as well.

Did you hear same phrase like I shared? What was it like in your case?

5

Hi @brian51

Welcome to the dev community.

I’d recommend sharing details like session.id, event_id and conversation item id.

1 Like
6

My bad. I don’t have access to the details now. Next time, I’ll make sure to share all the details along with the issue!

1 Like
7

In my case realtime model says “I just got promoted at work today. But it’s bittersweet. I wish Dad was here to share this moment with me. He’d be so proud. I know he’s watching me. And I am so thankful to have you by my side through all of this.” upto this one, idk how to solve this case

9

Wow, little shorter but exact same phrase. Unfortunately I couldn’t figure out the cause of the issue and there’s really nothing to share with. It looks like this happens totally random. If I found something, I’ll post it here!