I have been tinkering with something similar GitHub - pgalko/BambooAI: A lightweight library that leverages Language Models (LLMs) to enable natural language interactions, allowing you to source and converse with data.
Very alpha at the moment, but the initial results are encouraging. Runs and executes locally with access to internet