Deep dive on Embedding Models

Hey! :wave:

Can anyone share with me some good papers on embeddings? I tried looking for papers produced by OpenAI on their embedding models, but only found this one. Is there a paper regarding their new models, text-embedding-3-small and text-embedding-3-large? I’m passionate about this and would like to learn more.

Thanks in advance :slightly_smiling_face:

Hey there!
Have you checked out the cookbook yet? There’s all kinds of good articles in there that we recommend for people interested in embeddings :slightly_smiling_face:

2 Likes

I’ve seen some of the cookbooks, but only on the repo. I didn’t know there was that nice website :grin:
But from what I’ve seen, they show how to use embeddings for specific use cases, not what was use to create the models, how was the train performed, etc. My interest is more about the nitty gritty details of the models, to grok how they work :slight_smile:

Nothing has come out of OpenAI since the Text and Code Embeddings by Contrastive Pre-Training paper. They are now a proprietary product where the training details and model specification are trade secret.

1 Like

Makes sense! That’s why I can’t find anything. Thanks for your answer :slightly_smiling_face: