Hello everyone,
i fine tuned a model of gpt-3 to diagnouse diabetes and it works quite well. Now i wanted to compare it to a curie-base model using not only accuracy of prediction but perplexity.
Is there any easy way to get curies perplexity?
I just cant wrap my head around this.