Is ChatGPT API actually getting worse?

I am able to see both answers now and sometimes I like 3.5 better but mostly 4.0 really overwhelming responses are compelling a bit too many words but content is always very interesting and uses the 3.5 response in its answers the 3.5 will talk about and to 4.0

I am fascinated and completely satisfied with the values of both platforms

Arctic :fox_face: ltc “double trouble”

1 Like

Yes it is.In my project i faced whith this problem, I found a slightly strange but effective solution by pushing the first result into the same api and then it generates (fixes) great answers.

Summary created by AI.

The discussion begins with AgusPG suspecting a significant degradation in the ChatGPT API. They expressed concern over increasing latencies and inconsistencies between the Playground and API results, even when maintaining the same temperature.

RonaldGRuckus responds stating that there should be no differentiation between the playground and the API, as they operate with the same request logics . They propose the idea of streaming responses for faster response times.

AgusPG, while acknowledging these suggestions, reiterates the inconsistencies they’ve observed and promised to inspect the network logs for possible clues.

Another user, curt.kennedy introduces the idea of potential latency differences between pinned and unpinned models. RonaldGRuckus asserts that the difference can only be due to something different in the request or its format.

AgusPG recaps the discussion, expressing the necessity of differentiating the Playground and the API.

ruby_coder sharply criticizes RonaldGRuckus, stating that Playground manages both user session and dialog state, and isn’t just UI. They illustrate their point by sharing their experience of writing a Playground.

ruby_coder then posts again sharing a screenshot from status.openai.com showing a difference in outage numbers between the API and the Playground, further supporting their argument that the API and Playground are operationally different.

RonaldGRuckus, feeling insulted, asserts that their point all along was that the Playground utilizes the same API, not that the services are identical.

To conclude, EricGT provides linked references to similar topics about potential degradation in ChatGPT’s performance.

Summarized with AI on Nov 30 2023
AI used: gpt-4-32k