Hey! I’ve just been accepted for access to the GPT-4 API. Most of my usage for GPT (and I assume for a lot of people) has been through fine-tuning text generation. I tried to fine-tune an existing dataset using the modal “GPT-4”, but it was unsuccessful. I assume that you can only fine-tune with G…

Absolutely! I tried using the latest version of the CLI to try to fine-tune: openai api fine_tunes.create -t "prompt_prepared.jsonl" -m gpt-4 The response I got was: [organization=rapidtags] Error: Invalid base model: gpt-4 (model must be one of ada, babbage, curie, davinci) or a fine-tuned mode…

Yes it doesn’t seem to be fine-tunable per the response you shared. Btw the retrieve models request may have the permissions object which can tell a lot about what model can be used for.

I checked the models and can see fine-tuning is currently disabled for my GPT-4 modal. { "id": "gpt-4-0314", "object": "model", "created": 1678604601, "owned_by": "openai", "permission": [ { "id": "modelperm-jdiA8Wdn3bgYXXXXXXXXXXXX", "objec…

Yeah I will be surprise if GPT-4 can be fine-tuned any time soon (read a few weeks). Even davinci-text-003 couldn’t be fine tuned until a few weeks ago. It will be super awesome though if they skip the models in between (GPT-3.5 etc.) and allow fine-tuning on GPT-4 asap.

We are interested in building a chat application that utilizes a chatbot to provide law-related information to users. Our plan is to train the chatbot using GPT-4 with our custom data. As our laws data will be continuously changing, we are seeking advice on the best solution to develop this chat app…

I think it depends on your needs. Basically, fine-tuning is for “Analogical Reasoning”, while embeddings is like “finding a needle in a haystack”. If you want the chatbot to reply within your custom law-related information, then embeddings should fit you better. But if you want the chatbot to lea…

Every time you fine-tune a model (those provided by OpenAI, or your own previously fine tuned model) a new model and its associated files get created and they becomes available for you. This makes sense as you might want to do version control of your models and also what happens if fine tuning a mod…

This is an interesting discussion. What open source options would work for models or applications the retrieve legal or economic documents?

Recommend having a look around Hugging Face . Maybe search for “law” and see what existing models there are. Going down the path of opensource models will involve a significant learning curve.

Fine-tuning using GPT-4 Beta

API

sps March 16, 2023, 6:48pm 2

Hi @hello3

Congrats. Can you share the response of the retrieve model request for gpt-4?

1 Like

Topic		Replies	Views
GPT-3.5 Turbo fine-tuning now available (and new GPT3 models) API announcement , fine-tuning , api	18	16516	December 15, 2023
Fine tuning chat models -- coming soon? API	5	1477	December 15, 2023
When can we fine-tune gpt-4? API gpt-4 , fine-tuning	3	3094	November 9, 2023
Any idea when gpt-4 fine tuning will be released for everyone? API fine-tuning	15	5225	July 24, 2024
When can we fine tune gpt-3.5-turbo-0125? API fine-tuning	4	1156	February 29, 2024

Fine-tuning using GPT-4 Beta

Related topics