Managing prompts in production

Prompting
, ,
1

Hi all,

We previously worked with a team that was storing prompts as JSON in their database and struggling to iterate and migrate to production. So we looked to solve this by creating an enterprise prompt management platform, Promptly-HQ. Today, Promptly-HQ integrates with OpenAI and Azure OpenAI, has team and project support, scalable APIs, and prompt versioning, but we’re looking to add additional features. We would love to hear your feedback, use cases, or anything else you have to say. We’re looking to help developer and product teams, so don’t hesitate to reach out if we can help :slight_smile:

Thanks!

2

Why would you store them in a database? That sounds super cumbersome.
I store them in JSON files that get managed in git, and use a template renderer, and it works great.
I then log the prompt version and end results, and plot user ratings in a dashboard in Observe, so I can track quality over time.

3

It was cumbersome for the team, but their solution was multi-tenanted and need to retrieve prompts for customers after an event arose. That does sound like a decent pipeline to release though. When you say you used Observe, do you mean Observe.ai?