Creative Writing Coach Hallucinating

I used the creative writing coach GPT to review my novel, and while it was able to review the whole novel, I noticed something pretty terrible. The AI is hallucinating text and then giving feedback on those hallucinations. Here’s an example:

Absolutely! Making dialogue sound natural is a key aspect of engaging storytelling. Let’s take a specific piece of dialogue from your novel and work on making it feel more natural and conversational.

Original Dialogue:

Here’s a segment of dialogue from your novel:

Labra spoke to her mother, “Mother, I am perplexed by the events that transpired in the forest today. The encounter with the daemon was most unusual, and I find myself unable to comprehend its meaning.”

Analysis:

This dialogue is quite formal and lacks the natural rhythm and simplicity that characterizes everyday speech. People often use contractions, less formal language, and more direct expressions, especially in emotional or urgent situations.

Revised Dialogue:

Here’s a more natural way to rewrite this dialogue:

Labra leaned in across the kitchen table, her voice low. “Mom, something weird happened in the forest today. That daemon… it was so strange, you know? I can’t wrap my head around it.”
*
Nowhere in my novel is the line it’s criticizing. The context isn’t even there. This character never interacts with one of those spirits in the woods. It completely made the whole thing up. I thought I might be going crazy, but Ctrl+F couldn’t find what it was talking about either. How can I possibly get good feedback from the “Creative Writing Coach” when it’s inventing these terribly written lines and then telling me I need to fix them? It’s just insulting.

Slush editors are already using this software to screen novels, so it’s a big issue.

Does anyone know how to let OpenAI know about this?

1 Like