Hey everyone,
I’m using OpenAI’s platform for Evaluations, and I’m running into an issue. I’m trying to create a new evaluation by importing data from my Response Logs. After selecting the date range, setting up my test criteria, and hitting “Run,” I get the following error for every single row:
“Invalid value: ‘input_text’. Supported values are: ‘output_text’ and ‘refusal’.”
A few things to note:
-
Since the data was imported from logs, I can’t modify the column names.
-
I tried using different variables in the test criteria prompt —
{{item.input}},{{item.output}},{{sample.output_json}},{{sample.output_text}}— but none of them worked. -
The platform doesn’t allow downloading the logs to adjust them manually.
Has anyone else run into this issue or found a workaround?