I’m a bit new to OpenAI, have been working with it for a few weeks. I’ve been through the docs but as far as I can tell, evals are only available for Chat Completion. So hope someone can help me with these questions -
- I think it is possible for us to run evals and perform finetuning on a model, and then have an assistant that uses that model. Is this correct?
- Is something like Stored Completions possible for assistants, or is that not available? As far as I can see right now, analyzing past threads and manually creating a dataset for the evals is the only option.
- Any other recommended approaches if we want to use real conversations as training data?