We are using 4 and 4o for a bot that streams responses. As shown below in the response, the response from GPT API has numerous typos. We have tried a low temp of 0.2 and high temp of 0.7 without any impact. I’m sorry, Andy I’m really reluctant to to dealership. I spent a bit of time during my last …

In JS environment, if calling the API directly (instead of using the openai lib) with the stream option activated, the exact same logic would directly lead to the error mentioned in this thread. That is because sometimes the chunk in delta = chunk.choices[0].delta if chunk.choices and chunk.choice…

Im new here so apologise in advance for sounding like a dummy. I have a web app that uses gpt-4o api and like many of you here, im experiencing shocking responses where words and letters are missing. Is someone able to help me understand, something like this, will OpenAi fix this or is this someth…

import { Configuration, OpenAIApi } from "openai"; import dotenv from "dotenv"; import { IncomingMessage } from "http"; import { io } from "../index"; import { AnyArray } from "mongoose"; import Chat from "../models/chat"; dotenv.config(); /** * Takes in a prompt, base prompt, business prompt, an…

Welcome to the community. [image] toby2: something I’ll need to get my backend developer help me with? I would recommend this. Maybe point them to this thread. Make sure your OpenAI library is up to date, etc. Basically, the way streams are “chunked” has changed. No word on whether it will…

Im new here so apologise in advance for sounding like a dummy. I have a web app that uses gpt-4o api and like many of you here, im experiencing shocking responses where words and letters are missing. Is someone able to help me understand, something like this, will OpenAi fix this or is this someth…

I think my engineering team changed code at two places. One of them is posted above. I wil talk to them in few hours (based in India) and put the summary here for what to change. We use Node. So if you are using Python then use Claude to explain.

If you are passing your stream to a user in the browser you can take advantage of the Streams API. I haven’t noticed any issues and haven’t made any changes for my streaming from Deno → ReactJS for months. [image] Streams API - Web APIs | MDN The Streams API allows JavaScript to program…

Out user hear it instead of reading. So the stream needs to be converted into voice.

The Streams API was directed towards @toby2 It does work with any sort of format though - not limited to text. I’d recommend it always over using for await (const part of stream) if you want to add some complexity into your streams. @chinmay1 There’s a lot of external parts happening in your cod…

awesome thank you guys i ap[preciate your support and guidance!

If anyone’s doing it via a Javascript runtime (node.js, deno, bun, browser, etc), here’s our custom implementation using Javascript Fetch API for the communication with the streaming API: The inner function receives a ‘stream’ callback that will soft the burden on streaming the response into the c…

4o and 4 API output has typo/missing words

API Bugs

PaulBellow July 18, 2024, 10:13pm 56

Topic		Replies	Views
Streaming events returned bunched up Bugs	8	353	July 19, 2024
Chatgpt api (openai-node v4.26.0) stream issue with gpt-4 models Bugs	18	1632	February 15, 2024
[Realtime API] Audio is randomly cutting off at the end Bugs realtime , api-realtime	87	8012	April 9, 2026
Request failed with status code 400 API	43	62763	January 29, 2024
Streaming Responses - Exploring Cost-Efficient Alternatives to SSE with AWS Lambda & API Gateway API api	17	19324	February 29, 2024

4o and 4 API output has typo/missing words

Related topics