[Realtime API] Getting no response.done event for my conversation.item.create, response.create

I have established connection successfully, I am updating my session config and getting the correct response for the same.
I have some base64 encoded audio and that I send in the item object in my conversation.item.create. I get rate_limit.updated, conversation.item.created, response.created and response.output_item.added but there is no response.done event.

The input audio is 4-5s long. modalities has both audio and text. temperature is 0.8.

The response I get in event is

content_index:0 event_id:event_Af*********Yc item_id:item_Af********G output_index:0 part:map[transcript: type:audio] response_id:resp_Af***********MX type:response.content_part.added

The transcript is somehow empty in this. My sesssion config has been configured for whisper-1.

I wait for 30s and there’s no response.
Help me debug this issue. What may I be doing wrong?

I have the same issue!
response.done event is not always returned by openai realtime API.
here is my log, there is no response.done event returned.