As per the recent announcements: Audio in the Chat Completions API will be released in the coming weeks, as a new model gpt-4o-audio-preview. With gpt-4o-audio-preview, developers can input text or audio into GPT-4o and receive responses in text, audio, or both. I am eagerly awaiting this new gp…

Audio inputs are now available on chat completions @Dobo , using the model gpt-4o-audio-preview - which supports function calling well. [image] Audio support in the Chat Completions API Announcements The Chat Completions API now supports audio inputs and outputs using a ne…

[image] Dobo: I hope it’s not websockets! Websockets is the best way to make the two-way exchange of audio efficient… In the non-websocket case they’ll likely use Server Sent Events (SSE) like they do today. That’s essentially half-duplex websockets. And if you don’t want streaming at all I…

Sorry I should have clarified. We use serverless architecture with AWS Lambda for the backend, so we cannot do long running processes, hence WS is not practical. Also, looking at our users’ behaviour, 95% use text-to-speech and only 5% use voice transcription, so what users really want is to output…

Blockquote import { writeFileSync } from “node:fs”; import OpenAI from “openai”; const openai = new OpenAI(); // Generate an audio response to the given prompt const response = await openai.chat.completions.create({ model: “gpt-4o-audio-preview”, modalities: [“text”, “audio”], audio: { voi…

Exciting! Thanks for sharing. I just read the audio guide here: https://platform.openai.com/docs/guides/audio/faq?lang=javascript&audio-generation-quickstart-example=audio-out The examples are not using streaming so I wonder does this new model support streaming? I would love to be able to str…

I wonder does this new model support streaming? Yes, it does!

Does this mean that you can stream the audio output ? Or do you still have to wait for the audio fille to be completed ? how does this work ? Is there a example somewhere for playing the streamed audio while its coming in ? Havent played around with this yet

[image] Medy: Does this mean that you can stream the audio output ? I can confirm that the chat completions endpoint seem to support streaming text and audio modalities at the same time. The only supported audio format is pcm16. Example: { "model": "gpt-4o-audio-preview", "messages…

I am not sure that the response includes the full token usage: { "id": "chatcmpl-AKTisMkErFxmr5c3wz1p88sWVxa0T", "object": "chat.completion.chunk", "created": 1729444178, "model": "gpt-4o-audio-preview-2024-10-01", "system_fingerprint": "fp_4eafc16e9d", "choices": [], "u…

After the gpt-4o-audio-preview model is called using streaming, the data in the generated data is voice data in the pcm16 format. How to save and play this sound data. completion = client.chat.completions.create( model=model, modalities=["text", "audio"], audio={"voice": "alloy", "forma…

Waiting for gpt-4o-audio-preview

API

Topic		Replies	Views
Audio support in the Chat Completions API Announcements	11	6042	December 12, 2024
Will audio output streaming be available with GPT-4o? API audio , gpt-4o	1	1138	June 20, 2024
Speech-to-Speech (Audio Input/Output) with 4o API	5	1540	October 13, 2024
GPT4 audio preview with streaming of audio output API gpt-4	2	1091	January 18, 2025
GPT-Audio Not working - Error 500 API audio	13	724	October 9, 2025

Waiting for gpt-4o-audio-preview

Related topics