On one of the websites we manage, we have close to hundred of comments to moderate a day, so I coded a WordPress plugin: AI Comment Moderator.
How it works:
once configured (bring your own keys) the plugin starts checking the incoming comments and scores them based on their content, value to the website, user authority, etc.
based on the score following automated actions can be taken:
– reject comment
– trash comment
– mark as spam
– add to moderation queue for human review
– publish comment if the user has already published comments
– publish the comment if the score is excellent
– add to human moderation queue if the score is low (spam) but the author has previously approved comments
Each of the automated actions can be enabled/disabled and configured independently from each other, leaving you the full control and flexibility on your workflow.
Active and running since a couple of days it reduced the moderation time by 85 percents.
As for the API costs: average comment moderation request/response is about 500 tokens for gpt3.5 turbo, plus the plugin is coded to skip hitting the API as much as it can (feature to score without API calls the comments based on what was already scored by AI and is in spam or trash folder). So the costs are about $1 USD for 1K comments moderated by AI and free for the local scoring system. Currently we are paying about 10 cents a day for the API. So technically we pay 10 cents to buy back about 40 minutes of moderator’s time a day.
This plugin will be released as a premium plugin for WordPress at around 99 USD/site/year.
Currently we are looking for beta testers of the plugin to provide us some feedback and testimonials. We offer the first year of the plugin usage (excluding the API costs billed by OpenAI for your API usage). Then, a lifetime discount of 75% will be applied to all beta tester’s accounts.
If interested in testing the plugin: please send me a private message.
After running this for a while, I do confirm the costs are “peanuts” for accuracy close to 100%.
Side effect: we have a lot of commenters who have tens/hundreds of comments previously approved. Even if we always had a policy to manually review all comments before being published, we allowed automated publishing for comments from frequent commenters if the score is 9 out of 9… That ignited faster commenting from those people as their comments often get immediately approved. And by the time Google picks up the new post (minutes for us) we often have already several comments published on it…
