Finetuned Classification providing invalid response as classification

Hey there,

I’ve been training my own fine-tuned AI classifier and have about 1.1k~ manually classified rows of data for 9 categories. The completions are all numbered from 0 - 8 depending on the prompt and what category it falls into.

The problem is, sometimes my completion response is !. What does that mean? I’m not sure why it would classify something as that when none of my completions are like that.

I’m really unsure when it comes to debugging, is there anything I should be looking for that I’m missing? I’ve read the documentation. I am using the curie engine if it helps.

A screenshot is attached. I believe this is massively affecting my accuracy.

Maybe just not enough data?

I’m having the same issue. Was about to post a question about it? I’ve had similar results using ada, babbage, and curie.

I have ~2k observations and three categories.