Can context be added outside the prompt?

Welcome to the community @dexgamedev

Yes. It’s possible to add context with embeddings. I’m outlining how it should look like:

  1. Obtain embeddings for the context
  2. Run a semantic search on the embedding with the query.
  3. Use the top n results along with prompt to generate.
1 Like