Greetings!
I’m sorry to say, I have neither used langchain nor FAISS… Though I’ve looked up FAISS before thanks to your posts in other topics…
Both frameworks seem powerful and applicable to my use case. However, my own knowledge is so limited that I’ve developed everything exclusively in native python/regex and PSQL stores. Which honestly, has worked out just fine for me in terms of achieving the results I’m looking for, so far, but in actuality the “3d world state system” is the final component to finalize in my current system, and I’m absolutely struggling with it in terms of how to properly define rules/filters for amalgamating/filtering/refining the content within the datasets produced during the LLM runs..
So I see the value in considering/diving into the FAISS framework and such (as well as expanding my system outside of the native tools I’ve developed directly through langchain) but I’ll admit it’s all a bit over my head.
However, I’m relatively close now to nearing the goal for full autopoeitic activity by the LLM within the middleware system (alongside the users basic settings of tasks/goals/etc.), and hoping that it proves to be extensible and generalized enough to allow for rapid LLM-only development work to produce new applications, extensions, and frameworks as desired by the user (me, ha!).
So I feel like I’m going to keep powering along with the direction I’m in, and my intention realistically is that the first thing I would do is get the LLM using the system to “develop and code a new version of the system” (that perhaps, leverages these more expansive frameworks like you’ve mentioned!).
My own coding knowledge is just so limited that I had to build an entire frontend framework just to interact with the LLM and provide endpoints for “me” to use the system while the LLM’s responses are processed directly in the python, but my interaction with the system occurs through a TSX frontend.
So yes, my system is simply:
TSX frontend like this:
Backend like this:
(snippet of frontend showing the various files/folders in backend python aspect of system, left side showing docs currently shared with LLM, right side showing folders structure of backend, in total there are probably 40 python modules in the backend including routers and utilities, comprising probably 20k lines of python)
Everything communicates simply through SQL (i.e. all persistence/storage etc.)
I didn’t know how to code at all 6 months ago and have learned entirely through building the system with the LLM, and actually the LLM has produced 100% of all frontend/backend code, I haven’t written a single code line myself except some loggers… though I almost understand a lot of it now…
TL,DR; So point being my inexperience and ignorance leads me to wish that I had more to offer in terms of matching your current use of FAISS/langchain but I’m still on the python and tsx level exclusively in terms of my implementation of these ideas
Love what you shared though in terms of that blueprint document highlighting the usage of the “world state” concept - it’s definitely similar in some ways to my own - but my purpose for development doesn’t involve a “conversational” or “personal assistant” kind of usage of the LLM, actually, it’s exclusively focused on performing scientific research/development projects…