I just want to have a friendly discussion here not trying to be negative nancy or anything like that.
I’ve been using chatgpt for a while now and it is very obviously gaining a huge amount of popularity in such a small amount of time. I am a student studying ML and I find the evolvement of field to be deeply fascinating both to work on and observe. I think that much of the work that OpenAI has done with DALL-E and their hide and seek were super fascinating. Self play is truly incredible and I remember when the agents (seekers) were able to find and exploit a bug in the physics engine to surf on top of boxes. Generally speaking, I think that most of the work in RL (Hide&Seek/AlphaGo/etc) is greatly under appreciated.
Nowadays, especially after AI has become mainstream, the only thing people seem to care about are LLMs. Of course GPTs are SOTA, and while I don’t think the field of NLP is entirely boring and while I don’t doubt that later versions are going to become exponentially better, I feel like they have been too overhyped and that a lot of other fantastic work in AI has been overshadowed.
Just a thought, I hope that the future is more exciting than just trying to scale LLMs. I think it will be. I hope it will be. And I think we are definitely missing things. RL could play a huge part in the future, maybe other ideas we haven’t discovered yet as well. I think the best future is that which is the most exciting. Curious about what you all think about this.