Fine tuned perplexity

Hello everyone,

i fine tuned a model of gpt-3 to diagnouse diabetes and it works quite well. Now i wanted to compare it to a curie-base model using not only accuracy of prediction but perplexity.

Is there any easy way to get curies perplexity?

I just cant wrap my head around this.