New Beta Eval Feature - a few tips

API Feedback
1

I’ve been experimenting with the new beta Eval capabilities in the OpenAI dashboard. I was having a terrible time figuring out how to leverage the variables from my CSV import of prompts and user inputs. I finally figured it out and here’s some lessons learned so you don’t suffer the pain as well.

  1. If the CSV import doesn’t show any data in the preview (beyond the column headers) - it means it wasn’t able to parse the data. Something is wrong.

    image
    image1920×587 54.7 KB

  2. If you have ‘.’ characters in your column headers of your CSV, the data won’t parse :person_facepalming: The column headers need to be ‘.’ character free. See image above where my column headers have ‘.’ chars in them.

4 Likes
2

Your workaround is correct (no periods), but ideally it should allow them. We’re looking into it! Thanks for sharing the feedback.

2 Likes
3

Hi!
This is fixed, periods are totally fine, thanks for reporting, let us know if you have any other issues.

3 Likes