Does openai Question embeddings change everytime?

[20euai044]

Hello OpenAI community,

I’m currently working on a Retrieval-Augmented Generation (RAG) system for question answering, and I have a question regarding embeddings. Specifically, do the embeddings generated by OpenAI remain consistent every time?

I’m using the text-embedding-3-small model, and I’m unsure if the same question might produce different embeddings each time. I’ve noticed that the chunks picked up based on question changes, which affects the response.

Any insights would be appreciated!

[merefield]

Yes, very slightly, see this discussion:

Can text-embedding-ada-002 be made deterministic?

I’m using text-embedding-ada-002 for creating semantic embeddings from paragraphs of text. However, each time I call the API with the same paragraph, I get slightly different vectors back. This is surprising, and actually not great, because it can generate unnecessary differences and non-determinism in downstream processes. Is there some kind of temperature parameter I can set to make it be deterministic? (none is documented in the API endpoint docs.) The text doesn’t change, the semantic of t…

That’s why you should use some kind of tolerance range to determine what is similar and what is not similar enough, the range giving you the necessary flex to include all things which are similar enough whilst also handling the case when something identical has slightly different numbers.