For people interested in these, we have a bounty offer for anyone who manages to “jailbreak” the prompt in our application oHandle. Connect to the @coffee handle and give it a spin. Details in the post.
You can read more about this here. I also wrote up the mitigation strategies for everyone interested in creating an application around LLMs.