Understanding "text-embedding-ada-002" vector length of 1536

@opdx Welcome to the forum!
@gwillcc90 Welcome to the forum!

See: New and improved embedding model

The new embeddings have only 1536 dimensions, one-eighth the size of davinci-001 embeddings, making the new embeddings more cost effective in working with vector databases.

This is an OpenAI blog entry that specifically notes the same embedding model and size you note, please check the blog to learn more.

This is not a stupid question and one worthy of asking. Yes that is a large vector and it took me three hops in searching to find the blog entry. Started with ChatGPT then ChatGPT Plus using web browsing to get to a few research papers, then jumped to a Google search with both the model name and vector size to finally find the blog entry. The reason I started with ChatGPT Plus with web browsing was because I wanted a research paper with authors from OpenAI but that was not producing what I wanted so settled for the blog entry from OpenAI.

1 Like