Hello Dear team
We are following the documentation here:
we tried the models:
- gpt-live-transcribe (new one, the one we want to use)
- gpt-realtime-whisper
In both cases we have problems.
We expect to receive both deltas and final events:
ws.on("message", (data) => {
const event = JSON.parse(data);
if (event.type === "conversation.item.input_audio_transcription.delta") {
process.stdout.write(event.delta);
}
if (event.type === "conversation.item.input_audio_transcription.completed") {
console.log("\nFinal transcript:", event.transcript);
}
});
However, we are not receiving final events:
We realized that the session can be configured only with turn_detection turned off.
{
"type": "session.update",
"session": {
"type": "transcription",
"audio": {
"input": {
"format": {
"type": "audio/pcm",
"rate": 24000
},
"transcription": {
"model": "gpt-live-transcribe"
},
"turn_detection": null
}
}
}
}
If we do this, we receive only deltas but not final events
After this we follow the documentation to enable turn detection as reported here:
specifically this disclaimer
To let the server detect and commit turn boundaries, configure voice activity detection instead.
{
"type": "session.update",
"session": {
"type": "transcription",
"audio": {
"input": {
"format": { "type": "audio/pcm", "rate": 24000 },
"transcription": { "model": "gpt-live-transcribe" },
"turn_detection": {
"type": "server_vad",
"threshold": 0.8,
"prefix_padding_ms": 500,
"silence_duration_ms": 700
}
}
}
}
}
But then we get this error:
{
"message": "Turn detection is not supported for this transcription model.",
"type": "invalid_request_error",
"code": "invalid_value",
"param": "session.audio.input.turn_detection"
}
Can you please guide us and tell us what we are doing wrong?
Thanks so much guys
God bless