Bug in loading data for failed evals
When there are failed jobs for evals it will not let you open the data page to inspect. I can see in the code an error is being thrown that is causing this failure, but until then the evals platform is blocked
I am trying to use the evaluator platform with the simplest prompts.
I input as the user {{item.input}} and ask it to just make the text funny. No matter what prompt I try the output is always the exact same as the original input. I cannot figure out why considering I am even trying prompts I used in the past and they worked before and now no longer do. In addition it is still impossible to click the Data tab for the results one evaluations (filed in earlier ticket). Opening up data just leads to a blank screen.
Can you send a screenshot of what you’re seeing and the URL of the evaluation page?
I tried to repro your case, but I am not able to.
1 Like
I notice the errors when I add a csv files rather than custom inputs
Got it, thanks for the detail!
I’ll look into how to clarify this and the UX.
That prompt_data.csv file is a placeholder file name that represents the data on the right hand side.
If you go through the “Upload a file” flow, it should do what you’re expecting.
2 Likes
got it thank you that is very helpful!!
Yeah I guess its kind of confusing because in the other view you can remove the preset_file and then it lets you run it and will say the job failed but when you try to look why the page that shows you why refuses to open
1 Like
Yes, it is definitely confusing!
We will fix it
3 Likes
thank you for the help appreciate it!