ChatGPT data flow architecture

[novaphil]

Looks like that tutorial is using LangChain. Know that you aren’t “training” the LLM though. Try running LangChain in verbose mode and you can see the prompts it is using and how it stuffs your local data in the prompt. Under the hood it is using embeddings/vector storage, here’s an explainer from another community member:

How to create FAQ on internal company data?

Embeddings are your missing link. I created a couple of diagrams that provide a high-level overview of the process. You can find them here.