Evaluations UI in the Dashboard are failing

In the evaluation dashboard, when I try to run a grader the web page seems to “crash”, forcing me to reload. After reload, the grader cannot has not completed.

Similar behavior can be seen when using the Optimize button. A new prompt “tab” is created as usual, but then the page goes blank. Upon reload, the new prompt tab is gone and the optimize job is nowhere to be seen.

3 Likes

Agree, face the SAME issue: Prompt Optimizer DOESN’T work at all (dataset-based).

I’ve tried many times in different browsers and with different accounts:

  1. I have a prompt
  2. I have a dataset with grades, rating and feedback

I click OPTIMIZE button in the left corner and:
New prompt tab appears, optimizing prompt, but after few-seconds error occurs and tab disapperas.

Tried this MANY times in different days, different platforms, different accounts - the issue is still present. Always the same error appears:

**Failed to create auto prompt: {“message”:“The server had an error while processing your request. Sorry about that!”,“code”:“server_error”,“param”:null}

Server response returns:**
data: {“object”:“optimize.prompt.event”,“status”:“Routing”,“result”:null,“stream_event”:null}

data: {“object”:“optimize.prompt.event”,“status”:“Analyzing prompt”,“result”:null,“stream_event”:null}

event: error
data: {“message”:“The server had an error while processing your request. Sorry about that!”,“code”:“server_error”,“param”:null}


Does anybody face the same issue? Please HELP!

Hey everyone, Apologies for the delay in response. I tried to replicate the issue but the optimize button is working as expected on my end. Can you please confirm, if you are still facing the issue. Please also highlight what steps are you taking when you are encountering these issues? Thank you!

1 Like

Same error still happening with me. I’ve created 3 different datasets and tried optimizing the prompts. All failing with the following pop-up message:

Failed to create auto prompt: {"message":"The server had an error while processing your request. Sorry about that!","code":"server_error","param":null}

Steps to recreate:

  1. Create a dataset with name “test maths”

  2. Fill out data with math operations as you can see in the image

  3. Write System message

  4. Write Prompt Messages

  5. Hit Generate output

  6. Create a Scoring Grader named “Warmful” with “Must respond with a warmful message” description. Hit “Save and Run”

  7. Save prompt and name it as “math_prompt”

  8. Create a rating column named “rating”

  9. Save all

  10. Hit “Optimize”

Hello, Thank you for sharing the repro steps and unfortunately we are still not able to reproduce the issue on our end. I would request anybody to open a support request with us at support@openai.com and share a HAR file from this session (error is appearing). Please make sure to include your forum username and share your case id/subject here with us and we can debug it further. Thank you!