Can Model be trained from books?

Prompt Assistance
1

Hey, so basically what I want to achieve is to train GPT-3 Model to be able to create questions from set of many books and articles.
Let’s say it will train on books about dinosaurs, then will create a set of questions based on learning from them. For example - which dinosaur is the tallest ?
Is this something that can be done ?

1 Like
2

Hi Alex, If you can come up with simple prompts and completions, you can use a fine-tuning file

However, large documents are often processed using embedding. It will involve more work at your end - but it will ringfence the knowledge to what is in your articles and books

2 Likes
3

thanks ray, this is helpful. I need to figure out a source to get the embeddings so that I could train on my documents. can you point me to the direction pl

4

You need to break your documents down and use them as text for the embedding

There is a series of videos here that will explain the process

9 Likes
5

OMG you are super fast, and big thanks. the provided link is exhaustive with example videos. will go through it soon

3 Likes
6

@ raymonddavey thank you very much for the fast reply.
I think the video series you shared is what I needed. Ill watch them and will try use embeddings.
Again, thank you very much for the help.

1 Like
7

Alex, did you try pushing the text in as-is form