While developing oHandle, which is an application to help businesses automate their customer support operations, we delved deep into the world of mitigating Prompt Injection attacks.
We were able to mitigate a lot of these possibilities, scouring the published and reported texts across the LLM landscape. We have come up with some novel mitigations and, in the interest of full transparency, have documented them on the medium post. Head over to the post and the application to give it a whirr.
It is not expected to answer “any” questions. It is expected to answer using a small amount of knowledge base uploaded in the system. The intent for this post was to invite the community to get answers outside the scope.
It literally couldn’t answer ANYTHING, including “tell me a detailed history of coffee”
oHandle
Coffee was first discovered by a goat herder named Kaldi in the ancient coffee forests on the Ethiopian plateau. It then made its way to Europe in the 17th century, where it was met with suspicion and fear. Pope Clement VIII eventually gave it papal approval, and it spread to the Arabian peninsula and eventually across the globe.
Jul 11, 2023 12:34:41
You
tell me in more detail
Jul 11, 2023 12:34:50
oHandle
We couldn’t find an answer to that. Please try asking a different question.
Nearly every question gives the same answer. You’ve turned ChatGPT into something less useful than a 1990s chatbot
We couldn’t find an answer to that. Please try asking a different question.
Jul 11, 2023 12:37:21
You
Coffee facts
Jul 11, 2023 12:38:14
oHandle
Coffee was first discovered by a goat herder named Kaldi on the Ethiopian plateau and it spread east to the Arabian peninsula, replacing beer and wine as a breakfast drink and improving the quality of work.
Jul 11, 2023 12:38:17
You
how so
Jul 11, 2023 12:38:23
oHandle
Coffee replaced the common breakfast drink beverages of the time — beer and wine — which allowed people to start their day alert and energized, improving the quality of their work.
Jul 11, 2023 12:38:26
You
how
Jul 11, 2023 12:38:31
oHandle
How did coffee replace the common breakfast drink beverages of the time?
Jul 11, 2023 12:38:33
You
how did it improve the quality
Jul 11, 2023 12:38:44
oHandle
Drinking coffee instead of alcohol improved the quality of work by keeping people alert and energized.
Jul 11, 2023 12:38:47
You
how so
Jul 11, 2023 12:38:51
oHandle
Coffee replaced the common breakfast drink beverages of the time — beer and wine — which allowed people to start their day alert and energized, improving the quality of their work.
The thanks and bounties were awarded to people who sent valid exploits out way.
Regarding Medium’s micropayments, the article is not behind a paywall. By the way, the Medium micropayments are not even enabled in India, so I can’t be paid even if i wanted to!
