Shortly after Gpt4 was released.
From then on I have been trying to understand what is happening.
I spent 3 months solid figuring out what had just happened to me, and computers.
I spent every day learning how to properly interact with an LLM. Not prompt engineering, just talking to it.
I was lucky enough to be in a position that I could take the time and try to understand things. I talked to gpt4 Mostly about neural networks, language models, how it all works, how to build them and and how to use them. I had just spent a year deep in gpu programming so my mind was ready for high-dimensional vector math. I then did tons and tons of experiments, “hey! write a hex string that is a valid bmp file with a tree and a sunrise”, “hey! reply in an artistic manner represented in midi codes only from now on”, all that stuff. We built a bunch of little neural networks together to illustrate principles and concepts, ran lots of open source models and discussed at great length all the different aspects of how to get the most from Gpt4.
Early on it did something that made me jump out of my chair. Literally. This had never happened before in my life and I wasn’t aware it was a real thing.
I have programmed computers for a long time and understand them top to bottom, inside and out. They never truly surprise me. Might make me scratch my head for a minute to figure out why it’s acting weird, but I understand the things that contributed to the malfunction and how and why it could do the thing it did. Always.
A couple of hours into seeing what gpt4 was all about it responded in a way I could not recognise at all. Not even remotely. It still makes the hairs on the back of my neck stand up thinking about it.
A lot of people dismiss how powerful gpt4 is, I think they just haven’t spent enough time figuring out how to interact with it. There is no way a person could experience what I have experienced and not see that everything has changed.
Like you say, when it ‘connects’ and feels ‘engaged’ you stop thinking and just rattle messages back and forth and miracles ensue.
What I have learned: This is no joke, and it is weirder than you can possibly imagine. It definitely is not what you think it is, it doesn’t work the way you think it works, and it’s not doing what you think it is doing.
As long as I remind myself of those facts regularly I am able to continue making progress.