My average time spent in working with LLMs weekly is about 20 hours, I am a professional software engineer with ~30 years summed experience. I do all tasks code, text and understanding. The new experience in ChatGPT-4 is highly disappointing. I’ve been following the progress of ChatGPT since November 2022, immediately started using it to generate a bulk of my code of increasing complexity. A few weeks ago it was as if something has suddenly broken big time. I would have easily paid a 100$ per month for using ChatGPT-4, or even $200. Now I’d move to a rival, Claude 2, which seems to behave quite better in my overall assessment. The contrast is expecially stark drawing a line between Claude-2-100k and Gpt-4-32k, the latter is just really dumb as compared. I’ve created sophisticated prompts for all my use cases which were doing wonders with ChatGPT-4, until recently. Now no prompt could fix the deficiency of the updated Gpt-4 for me. And lastly, this was a first ever week when I got code answers from Bard better than ChatGPT-4, I couldn’t imagine that would happen. In some scenarious where I tried GPT-3.5-16k via an API, it still was better than GPT-4-32k, crazy. Very unfortunate.
1 Like