Hi I have been doing a lot of post-reading and watching videos on the use cases and applicability of fine-tuning vs embedding. Over this time, my understanding of whether I should or can use fine-tuning to introduce new knowledge has flip-flopped several times. I have read that fine-tuning is not …

I got you, this is hard to find a guide line… I recommand you to read those two : [image] OpenAI’s Embedding Model With Vector Database The updated Embedding model offers State-of-the-Art performance with 4x longer context window. Thew new model is 90% cheaper. The smaller… Re…

If you want a detailed walkthrough on using embeddings for questions about Mars, I would mimic this tutorial. Basically, you embed all your facts about Mars. Then the incoming question comes in and you embed this. You correlate your incoming question with the entire set of embedded facts. Then b…

I have signed up for the course. Thank you @pinardalec

What you describe @curt.kennedy is where my current thinking is at. Thank you.

Interesting discussion. Another point of view might be Codex. Do I prefer building embeddings with my (company’s private) code bases or using fine-tuning?

The embeddings vs fine tuning is a great question, I think we should update the docs to give better guidance on this, I will add it to the queue but there’s a lot of other things that need to be updated before that so hang tight.

This is a clear answer and I agree, but to me the elephant in the room is the size constraint placed on the prompt. It limits the context of the prompt and therefore the resources available to answer.

I found this video quite useful in understanding the difference [What is Fine-tuning and Embeddings in GPT-3?] From my understanding Fine-tuning is a way to add new knowledge to an existing model. So it’s a simple upgrade, same usage. Embedding is a way to let the model search in a “…

Hi So just to understand clearly, what this video suggests is that if we want GPT to answer questions pertaining to our domain/custom data which will also lead to minimal or no hallucination, then Embeddings is the way to go over Fine -Tuning. As Fine-tuning will augument the data but GPT will still…

Hi Is there an update to doc on the diff between the two? Also is my understanding in the below comment correct?

Fine tuning vs. Embedding

API

pinardalec January 14, 2023, 9:39pm 2

I got you, this is hard to find a guide line…

I recommand you to read those two :

3 Likes

Topic		Replies	Views
Need some help with understanding embedding/fine-tuning API	2	1662	December 17, 2023
What's better for the type of chatbot I am building? Fine tune or embedding? Community chatgpt , api	10	2423	August 20, 2023
Fine-tuning myths / OpenAI documentation API	24	15240	December 23, 2023
How can we make the answer concise with fine tuning? API fine-tuning , api	8	3064	June 7, 2023
Prompt Assistance , Potentially Fine Tuning oddity Prompting	6	1300	February 7, 2023

Fine tuning vs. Embedding

Related topics