On one of the websites we manage, we have close to hundred of comments to moderate a day, so I coded a WordPress plugin: AI Comment Moderator.
How it works:
once configured (bring your own keys) the plugin starts checking the incoming comments and scores them based on their content, value to the website, user authority, etc.
based on the score following automated actions can be taken:
– reject comment
– trash comment
– mark as spam
– add to moderation queue for human review
– publish comment if the user has already published comments
– publish the comment if the score is excellent
– add to human moderation queue if the score is low (spam) but the author has previously approved comments
Each of the automated actions can be enabled/disabled and configured independently from each other, leaving you the full control and flexibility on your workflow.
Active and running since a couple of days it reduced the moderation time by 85 percents.
As for the API costs: average comment moderation request/response is about 500 tokens for gpt3.5 turbo, plus the plugin is coded to skip hitting the API as much as it can (feature to score without API calls the comments based on what was already scored by AI and is in spam or trash folder). So the costs are about $1 USD for 1K comments moderated by AI and free for the local scoring system. Currently we are paying about 10 cents a day for the API. So technically we pay 10 cents to buy back about 40 minutes of moderator’s time a day.
This plugin will be released as a premium plugin for WordPress at around 99 USD/site/year.
Currently we are looking for beta testers of the plugin to provide us some feedback and testimonials. We offer the first year of the plugin usage (excluding the API costs billed by OpenAI for your API usage). Then, a lifetime discount of 75% will be applied to all beta tester’s accounts.
If interested in testing the plugin: please send me a private message.
After running this for a while, I do confirm the costs are “peanuts” for accuracy close to 100%.
Side effect: we have a lot of commenters who have tens/hundreds of comments previously approved. Even if we always had a policy to manually review all comments before being published, we allowed automated publishing for comments from frequent commenters if the score is 9 out of 9… That ignited faster commenting from those people as their comments often get immediately approved. And by the time Google picks up the new post (minutes for us) we often have already several comments published on it…
Hi @EmilianoS , not yet, the plugin store takes some more time to launch as I had a couple of other projects going on. Currently the beta-tester’s enrollment is closed. But I plan to start sales in about 30 days. The price will be 9.99 USD/month or 99.00 USD/year + whatever price charged by Open AI for the API usage (we pay something like 1.00 USD/1K comments moderated).
Plugin monthly price is pretty much the same as Akismet but includes automation. Others players in the field charge around 40 USD/month for 10K comments moderated.
@dmalone , hi David, no not yet, was busy doing other (more lucrative) things:
winning combo of WordPress + OpenAI + vidon.ai ( https://vidon.ai ) that takes your blog post and turns it into a video for social platform / YouTube with voice over (they added openAI voices last week after my request a month ago) , also supports multi brand and fine - tuning to speed up script generation and is fully managed from WP admin.
@sergeliatko - got here from a Google search. Did you launch yet? If so, I’ll sign up. We manage hundreds of WordPress sites, although most have comments turned off. For our marketing clients, we’re turning them on and would need something like this to help manage them. Don’t wanna build this ourselves