What if I input a particularly important text redundantly two or three times. Does that somehow help the chatbot to give additional weight to those words?
For example, say you’re creating a GPT to answer questions about operating a nuclear submarine. On the one hand, you will input very broad set of information about every aspect of the sub. But on the other, safety is paramount. So what happens if you submit the safety manual two or three times, redundantly. Does that add weight or emphasis to the responses the GPT generates?
One expert suggested “Theoretically you can increase emphasis via duplication. However, their fine-tuning algorithm may dedupe the corpus as a preliminary step.”