Can someone explains to a 5yo what embeddings can do that fine-tuning cannot do? What are tasks that they can both do? And what are tasks that one can and the other not?

OK, for a 12 year old maybe? Fine tuning takes the reply of a ChatBot and changes it. Embeddings represent text as numbers so we can search. select, classify or group similar text.

[image] ruby_coder: Fine tuning takes the reply of a ChatBot and changes it. Would this be similar to how a hypernetwork adjusts weights?

The Embeddings API returns a vector - a list of numbers like this: [ -0.006929283495992422, -0.005336422007530928, ... -4.547132266452536e-05, -0.024047505110502243 ], It measures the relatedness of strings. You can use it to implement services like re…

Is it correct that fine-tuning a model does not change the code to interact with the API other than to change the model to be used? Whereas to take advantage of embeddings you can no longer have very simple code which merely uses the API to present a prompt and get a response, but rather with emb…

[image] rkaplan: Is it correct that fine-tuning a model does not change the code to interact with the API other than to change the model to be used? Yes, you can see sample requests here: https://platform.openai.com/docs/guides/fine-tuning/use-a-fine-tuned-model [image] rkaplan: Whereas …

Thanks all. Isn’t it true that you can formulate every search problem as Q &A? Search: Bill Gate’s cars make. Question: What is Bill Gate’s car make. If so, when do you use embeddings and when to you use Q&A for the same problem.

[image] branchette: Can someone explains to a 5yo what embeddings can do that fine-tuning cannot do? What are tasks that they can both do? And what are tasks that one can and the other not? you can check out this video you can check out this video OpenAI Q&A: Finetuning GPT-3 vs Semantic Sear…

Fine-tune vs Embedding

Documentation

branchette February 13, 2023, 4:29pm 8

This thread answers my question: Finetuning for Domain Knowledge and Questions - #8 by ic202

Topic		Replies	Views
Fine-Tuning plus Embedding API	2	5064	May 3, 2023
Finetuning for Domain Knowledge and Questions Documentation	10	19796	May 15, 2023
Need some help with understanding embedding/fine-tuning API	1	1696	March 22, 2023
Preprocessing - I just don’t get it! API	14	3429	January 6, 2023
Fine tuned, embedding or semantic search API	3	1154	February 25, 2024

Fine-tune vs Embedding

Related topics