GPT-3, DALL-E, and our Multimodal Future [YouTube Video Series]

Thanks for these amazing videos

2 Likes

My pleasure @itsanishjain ! What’s been your favourite part so far?

I wanted to share today’s video on composition and phrasing, this is a really important lesson which I believe will become the dominant mindset shift as more creatives start using AI models like DALL-E:

You have probably already seen some people taking on this shift even when it comes to GPT-3.

Please let me know below if you have any thoughts or any questions about the series so far and I’ll do my best to answer!

4 Likes

:joy::joy: Zuck is the universal symbol for being a socially awkward developer, he’ll be back for a bit later in the series.

Me too! Even making animated graphics for this series at times was painful, I wish I could just communicate them into existence with multimodal AI.

1 Like

Today’s video is a lot of fun! Do you remember the very famous and meme-worthy avocado chair from the DALL-E paper? Well, I made an awesome video turning it into a real thing:

2 Likes

this is a beautiful point. I hadn’t even considered actually using one of these practically in my daily life. It would probably not be as comfortable since you can’t lean back lol

do you have an example of a pear chair in Switzerland? I didn’t know there was such a thing! You guys are always ahead of us in design

1 Like

I had a great chat today with @techn0cratic about the series and even some GPT-3 stuff! Check it out below:
https://www.twitch.tv/videos/1138885156

The series resumes on Monday!

2 Likes

I like very much the key ideas in the #2 and #3 videos! Very strong and real arguments

1 Like

Fantastic insights, thank you so much for sitting down and chatting with me :heart:

2 Likes

All of this is good and all, you’re making it sound like this tech will be available to everyone at the same time, I don’t think so. DALL-E, codex , gpt4 ect. will be given to the Elite, or those who can afford it. Multimodal if for sure the future, but who gets it and when is the question. Just like codex is not available to everyone now (Which does not make sense). Pointless to have a tech, thats only 0.001% of the population has access to it.

This is a really good point. However, the 2-10 year timeline I’m talking about is when I speculate ordinary people will get access to it. You’re right, they may need to be a part of something like the OpenAI beta, but at least it will be available to ordinary people (maybe the beta will be much bigger by then). The series doesn’t attempt to guess when the ultra-elite, very privately funded, may create it independently and keep it all for themselves … that’s way too hard to know without inside information.

Pleasure was all mine!!! I want to turn the tables and interview you next on my podcast, I’ll DM you on Twitter about it in a few weeks.

1 Like

If everyone has access to the same AI tools, how will we come up with new things? Where will novelty come from?

I answer this really important question in today’s video:

Enjoy!

2 Likes

I appreciate your views on the multimodal approach, through my own personal research as a programmer it seems like this is the future. A smart friend of mine pitched me an idea for pretty much this exact concept (he doesn’t know ai implementation much he’s just smart) and that’s what sparked my research and then shortly after, google mentioned how they’re working on their perceiver which focuses on being multimodal and more general from a data input standpoint. I believe that people are starting to understand more what approaches we need in order to abstract the processes needed for human-like data interpretation and compression. What a time to be alive, for rich people at the top of companies lol.

1 Like

I agree with you @tyler.csurilla I’m very excited and grateful for the era we are living in. I’m also optimistic that many of the commercial challenges like latency, availability, and character limits will be addressed overtime.

1 Like

I enjoyed this video, it raised a lot of good questions.

I thought I’d address the concept of taste, and whether it can be taught. It can. Or rather, its development can be encouraged. Here’s how.

I taught graduate level creative writing for eight years. One of the most important parts was developing an individual reading list with my students. I’d have them come in with ten titles of books they liked. I’d then look at this list and come up with an assigned reading list that meshed with and elevated their taste. Say, for instance, that a student was a science fiction fan. I’d introduce them to European writers like Stanislaw Lem, Bruno Schulz, Italo Calvino–authors whose work was fantastical and otherworldly, but who paid closer attention to the beauty of language itself. The point was always to get them to demand more out of the art they consume. Once you’re able to spot the tropes in what you’re reading, you derive less pleasure from it, and you start seeking out more challenging work and elevating your taste. You can still honor the foundations of your taste while pushing it to become more sophisticated.

Taste is about not only defining what you like, but why you like it. There’s a quite excellent book in the 33 1/3 series of books on music about Celine Dion that is the best thing I’ve ever read about taste. Totally not joking. Here it is: https://www.amazon.com/Celine-Dions-Lets-Talk-About/dp/082642788X

This is an awesome insight @boudinot thank you so much for sharing. I’ve added the book to my personal reading list. This is great evidence that perhaps taste can be taught in schools (or at least elevated) like you mentioned, by spotting tropes and seeking greater influences, pushing your own work forward.

The kind of taste I’m proposing, I suppose, after rewatching my own video lol is the kind that becomes a dominant communication style, or something singular which enters the public zeitgeist in a really meaningful way. I suppose when I’m talking about “taste” I am collectively referring to taste, advancement, but also “setting” some kind of mainstream trend the masses adopt which becomes a norm … really influencing culture. I’m not saying what you’re proposing isn’t the pathway to that, but is there is something distinctive about this kind of taste (the kind that a society adopts) in your experience? Or are many of those cases elevated taste like you’re describing, with a one-of-a-kind life story that just resonates with society and the times?

There’s so much nuisance here of what makes great taste and what doesn’t. I think, as a society, we can spot poor taste in some shared way pretty easily, even though all of our tastes should be some kind of a subjective thing. One of my favourite subreddits is called Awful Taste but Great Execution, for the most part, as a collective we can agree many of things posted are in poor taste, but we may differ on our views on “great taste”. Many of my favourite things I did not like right away, it took some time for me to, “get over it” as they may have been something completely new. I guess I’d also love to ask you, what can we learn from poor taste? How does it help us define great/elevated taste?

Video #6 is up, folks!

It’s about the importance of art theory and design language, especially with Multimodal AI models in the future:

2 Likes

Good questions. I used to be super engaged with questions of taste, now I just like what I like and don’t theorize about it too much. I think you’re asking about how taste develops collectively. I don’t know how much I can offer on that, but I will say that it’s going to be really interesting when human writers are influenced by literature composed by AIs. It’ll be a really fascinating feedback loop.

2 Likes

I agree. I have a video coming up (I believe even this week) on AI based feedback.

Btw - the book is incredible so far, I’m on chapter 2/3. I never even thought about how much taste is driven by people’s own backgrounds and can be viewed relatively depending upon the audience. Thanks for sharing, I’m looking forward to finishing it hopefully this week.

Today’s video is a more philosophical one. It questions the “role” of human creatives in the future if AI can do a lot more of the work.

This video asks an important question and I’m excited to hear any thoughts and comments you all may have below.

2 Likes