Can anyone share with me some good papers on embeddings? I tried looking for papers produced by OpenAI on their embedding models, but only found this one. Is there a paper regarding their new models, text-embedding-3-small and text-embedding-3-large? I’m passionate about this and would like to learn more.
I’ve seen some of the cookbooks, but only on the repo. I didn’t know there was that nice website
But from what I’ve seen, they show how to use embeddings for specific use cases, not what was use to create the models, how was the train performed, etc. My interest is more about the nitty gritty details of the models, to grok how they work
Nothing has come out of OpenAI since the Text and Code Embeddings by Contrastive Pre-Training paper. They are now a proprietary product where the training details and model specification are trade secret.