Assistants - Embeddings and Vector Stores

API
, ,
10

I’d recommend use Astra DB or some such external vector store + Assistant APIs

While rightly pointed out earlier, OpenAI does take care of chunking, embedding and vector search.

You can programatically add new email json to OpenAI files or external source for a decoupled scalable architecture.

Writing yourself a detailed app in a preferred framework (django or nextjs) that uses the power of assistant API via simple OpenAI SDKs, leverage features such as:

  • threading
  • runs
  • polling
  • actions
  • etc …

Source of truth remains an external vector store, that can have CI capabilities with your emails. Processing and query remains within your app via Assistant APIs

More or less this topic’s thread and your plan is on right lines. Tweak it, and do share it ahead.