Not even close to GPT 4.
As everyone here said, it is redundant, does cirlces, bad at coding, wrong many times. frustrating.
Can someone explain to me how it can top all leaderboards? Did they use a better version for the tests or what am I missing?
OpenAI do something the new version is a mess and people paid for something better!!!
All these AI’s kind of know how benchmarks are tested and they can make some adjustment to pass test and top leaderboards. Real life scenarios are different from basic test scenarios. I see no other reason for such poor performance in reality vs test.
Also, i think these models are more like flash models and not full fledged models. Gemini pro vs flash models perform way different. Even GPT 4 vs 4o performs different . These models are cost effective not performance effective.
Yup totally agree, and it kind of worrying that they now consider GPT4 a legacy model… I always switch to GPT4 for any code related works. Gpt 4o seems to be the result of their tests a few months ago where GPT4 suddenly seemed to decrease in performance.
its performing badly when it comes to copy writing as well. I’m thinking of moving to another platform if this continues!
GPT4o is really amazingly bad at coding.
Gave the same script to GPT 4 “Legacy” and GPT 4o.
GPT 4o code did not work directly, GPT 4 “legacy” code worked right off the bat. (copied the exact same prompt)
Cancelled my sub and will definitely look for alternatives.
My gut feeling:
GPT4 was good, but too expensive to run, so they tried to “optimize” (aka dumb down) to save cost.
Sad.
Agreed. It’s pretty bad. I can’t even use it for simple html snippets. What a waste of time.
The new version of GPT-4o as of Aug 20 is ten times better now. It’s more eager to understand issues and resolve them through discussion rather than just running off producing code! Give it a try I’m impressed!
What worked for me too, is mentioning in my prompt to not over-engineer and write clean and simple code.
Still it is way worse than the “legacy” GPT4 model 
It still over-engineers, solutions do not work properly on the first try compared to GPT4 “legacy” (pasted same prompt and compared solutions).
It is definitely a step down still
Its absolutely useless, open AI needs a good kicking for ruining it.
The funny thing is, GPT-4 was quite good, then eventually it become useless where I spent more time swearing at it then getting anything done, wasting hours and hours of my time.
Then we got GPT-4o and I thought all my problems were solved, well they were for a short time, now the same pattern occured, the only thing it has gotten better as is taking the swearing I’m giving it.
So now all I can do is revert to using legacy 4.
Somebody else has got to provde a better solution for coding, too much experimentation going on is making open AI unreliable.