How do you guys avoid users asking controversial prompt? I want my users to be only asking questions about the domain and not about controversial topics like religion or politics since that is not the goal of what im making.
1 Like
This is a tough one since the definition of what is controversial is really controversial.
You can play with the content filter, and turn up the strictness of the filter, i.e. only accept if the content filter returns 0. Be wary of false positives in that case. This is similar to what we use in our application, BookMapp
If the list of topics that you want to classify as controversial is known, you can just do a classification query with examples of controversial topics AND examples of “allowed” explicitly provided, and only allow ones that return “allowed”.