NEFTune: adding noise to vector embeddings

OpenAI does not use neftune as a parameter, but you can use learning_rate_multiplier to achieve the same goal. More information over here:

https://platform.openai.com/docs/api-reference/fine-tuning/create#fine-tuning-create-hyperparameters

3 Likes