I have encountered a (I think) serious bug in custom GPT’s.
When loaded with some custom data from an external server, it can’t remember anything of that particular data after the 1st message: it has to connect to the external server (where the data is stored) every single time.
Ask a question? Needs to connect.
Another question? Needs to connect.
Etc…
This bug was introduced after the web-update (same day when 5.6 / SOL was rolled out). But since then it also happens in 5.4 / 5.5 / etc… so it’s not strictly tied to 5.6.
I have opened a ticket to AI support (using the chatbot and forcing it to escalate the bug to humans).
Some hours later, I received a message from - let say’s - Dirk. And Dirk is working for Open AI.
He said “my bug was a real bug and more users on the forum are reporting it”.
Okay, cool. Thanks.
He also asked for a detailed walkthrough and screenrecording.
So I made both. Very detailed, reproducible, step by step. And a movie from about minutes, clearly exposing the bug.
Then I got another mail, saying very universal things about “how GPT’s work” and “that it’s normal that GPT’s can’t answer to all questions” .
I know, but that’s not the bug: it can’t remember anything after one message. Even when the fetched data says “X has an age of Y years”, it can’t tell me the age of X.
Only after pinging the server, fetching the data again, it can say the age of X.
But “Dirk” did not mention my movie recordings, not mentioning my list of steps. Nothing.
He asked for “a movie recording” and “detailed guide”, which I had already sent.
So I created a new one, send it again.
Then Dirk came back, telling me absolute “crap” about compiling .msdata packages or some thing. And that GPT can not compile executables, although it is pretending it can.
What is this?
Is “Dirk” still a bot, or is something going wrong?
I asked “Dirk” to stop responding, connect me to a human being, escalate the level of bug report, etc… but then it (or he) when silent.