ChatKit Agent run 500 errors?

Anyone experiencing 500 internal server errors with long running Agent jobs? Actually the job isn’t really that long, its actually a ChatKit Client Tools call thats just supposed to render content to front end - but I’m seeing repeated 500 errors and failures in playground.

{
  "exception": "ServerError[500, internal=Response was incomplete., user=The server had an error while processing your request. Sorry about that!, internal_extra={}]"
}
1 Like

could to explain in a little more detail how your setup works/fails? I’ve had to solve for long running tasks recently and could potentially help.

1 Like

Hi - sorry yeah, I will often just get a 500 server error when my agents are working through calls. Here’s a snapshot of what my agent builder workflow looks like. The big loop in the middle makes a series of LLM calls with state variables containing context. I’ve turned of chat history for most of the other nodes as I found that has helped ease some of the server errors (likely due to context window blowing up) - that being said, I still run into the server error issue or client tool / function just not getting called.