Ensuring GPT Consistently Follows a Defined Scoring System: Tips and Best Practices?

Of course!

That’s why I also suggested you look at running one of their pre-trained models locally if you have a modern NVIDIA GPU with 16GB of VRAM.

I think the use case for something like this is a bunch of high school teachers who want to outsource their grading. :joy:

Now there’s an application someone could sell.

Fine-tune a model to build the rubric, fine-tune a model to grade based on a rubric, teachers upload their assignment, build the rubric for them, then they upload a zip file of their students’ work and download a CSV file ready to be uploaded into any of the popular learning management systems.

Give away the rubric and charge $0.15 / assignment graded.

Teacher with 40 students just graded all the assignments in about a minute for $6.00.

Hmmm… :thinking:

Less than $5k up-front costs, probably $0.05 / assignment to actually grade. Break even point (after all other expenses considered is probably between 100k–200k assignments graded.

Figure an average teacher might grade 10 assignments × 25 students / year, and one could be in the black with between 400 and 1000 regular customers for a year.

After that you could have yourself a nice little $2,000–$5,000 / month passive income without even getting very big.

1 Like