I’m using raw material (like KB articles) and GPT-3 to synthesize data. Also there’s a fantastic dataset from Stack Exchange. I searched Kaggle Datasets to find tons of data. The short version is that you find lots of data that is “close enough” to bootstrap your project and then you use GPT-3 to synthesize the rest of the fine-tuning dataset.
2 Likes