When will Evaluation API be ready?

I’m currently working with OpenAI’s model evaluation tools and am in need of API support, which is useful for automating the train and eval pipeline.

I’d appreciate any guidance on how to proceed. Thanks in advance for your help!

Hi, we don’t have an API timeline available yet, but we have been thinking about it!

What automation are you looking for?

5 Likes

I’m interested in automating the evaluation process through an API and automatically storing the data. Is this feature available?

Thank you in advance!

We don’t have an API available yet, but it is planned.
What features would you like in the API?/have you tried the UI experience?