Welcome to the community @dexgamedev
Yes. It’s possible to add context with embeddings. I’m outlining how it should look like:
- Obtain embeddings for the context
- Run a semantic search on the embedding with the query.
- Use the top n results along with prompt to generate.