I’ve been trying to get GPT-3 to paraphrase passages of text, with no success.
With all prompts i tried, at low temperatures, GPT-3 repeats the input text. At high temperatures, it starts to produce factually incorrect sentences. For the use case I have in mind, the model needs to produce factually correct output in at least 95% of the time. But the text should also be sufficiently different from the original.
Example prompt Paraphrase the original passage. """""" Original passage:
"""""" Paraphrased passage:
Has anyone cracked paraphrasing? I also tried one-shot and few-shot prompts but with similar results.
That’s an important note to keep in mind, @m-a.schenk!
@daveshapautomator that’s a great prompt. I’ve had a lot of success using davinci-instruct-beta with no examples at all (with penalties to the max to avoid repeating the prompt, and a medium temperature).
The issue is, that as soon as the model “coincidentally” returns one sentence, that is the same as in the input, all the remaining sentences are exact copies (which seems natural given the “predict next word” objective of the model). See e.g. the last two sentences in your output, they match the input exactly.
This is just a starting point, and I’d definitely add high-quality, varied examples to help the API.
Edit: To add to that, you could also re-phrase one sentence at a time, circumventing the problem of entire paragraphs not being properly re-phrased. That said, this is entirely different from the earlier suggestion of providing examples, so I’d try both out, depending on your exact needs.
If you’re paraphrasing a list of items, GPT-3 won’t shorten the source material. A list can be anything that has similar meaning.
For example: “I went to the foyer. Then I put on my shoes. Then I opened the door. Then I…”
Summarization works best when each sentence adds to the overall theme, without adding too much new repeatable information. Think narrative arc.
For example: “He had a tattoo on his left wrist. It was a star from his neighborhood childhood, he told me. He seemed downcast when he looked down at it, as if he was appraising a faded picture of long dead relatives in some attic. I’ve always remembered that tattoo…”
Hi All. I have a question regarding paraphrasing. English is not my native language. I ask AI help me check grammar or paraphrase my original sentences. In some cases, it doesn’t change, in some provides some suggestions. I use some of these suggestions in writing my book. I try not to copy-paste but modify slightly. Are there any ethical issues?
