We built a plugin that can fetch information for an entity from internet. So sometimes, a user asks “can you summarize A?” on ChatGPT. And we generated a very long JSON response to ChatGPT. What we notice is that ChatGPT can generate relevant and coherent texts for the first few sentences. And somew…

ChatGPT halluciating with very long plugin response

shinewu June 6, 2023, 3:35pm 4

Have not found a super general solution for this. But let’s all hope OpenAI lifts the context window to 100k for everyone soon!

Topic		Replies	Views
ChatGPT Plugins Context Length Plugins / Actions builders	8	1861	June 29, 2023
My json response is under 38k characters and the response is hallucinating Plugin store plugin-development	3	603	January 6, 2024
Best length of Plugin API response to avoid chatgpt hallucination Plugins / Actions builders chatgpt , plugin-development , chatgpt-plugin	1	591	December 15, 2023
How exactly does plugin chatGPT handle conversations >8k tokens Plugins / Actions builders plugin-development , context-elements	1	569	June 15, 2023
ChatGPT still hallucinates data even with api response Plugins / Actions builders	22	1956	April 25, 2023