Folks, I’m making a suggestion to AI providers on how to persist context across prompts.
I called it Context Package (CP).
The idea is simple. A CP would be sent to the server along with the first prompt with the information that the app needs to use for every prompt.
The CP persists on the server for the duration of the session and can be edited or removed.
More CPs can be created as needed.
You can learn more about this proposal on my Medium article (search for “Prompt Engineering Is a Workaround. Context Infrastructure Is the Future.“).
This could solve the context issue we all face when developing our apps where the model “forgets” important things and give us, developers, control over it.
Please let me know your thoughts.