Hi everyone,
What do you think about an open-source, self-hosted Tracing Dashboard for OpenAI Agents?
I was building a solution for a company and found that tools like Langfuse had too many detailed features, while LangSmith is fine, but not really tailored for pure OpenAI Agents.
I’m curious would anyone be interested in building or using an open-source alternative? If there’s enough demand, I can build and release it as open-source.
I’m not sure about having to host a tracing server, but perhaps something that can generate local log files would be interesting.
The only issue I have with openai tracing is that currently there is no way to delete and they will remain there forever.
I’m also testing langsmith but it seems that deleting a trace is also not supported in the dashboard UI, which makes is also a bit troublesome.
Sometimes all we need is a simple log file to check what went wrong, without having to create one more service to mantain.
I wish there was an easier way for these logs to expire withing a certain amount of days.
Hey everyone, I’ve released this as an open source tool for tracing and analyzing AI agent workflows.
Check it out here: github.com/yusuf-eren/openai-agents-tracing
Below are some screenshots showing the dashboards and analytics views:
|
Traces Page |
Trace Detail Page |
|
Costs & Usage Page |
Setup Page |
Supports all models available through Vercel AI SDK, including OpenAI GPT 4, GPT 4o, o1, o3 mini, Anthropic Claude, Google Gemini, and many others.
Based on the AI SDK tracing spec. Provides self hosted monitoring, cost tracking, and advanced filtering. These are not available in the official OpenAI tracing.
Open source and open to contribution. Feel free to reach out & open a pull request or an issue.
