Hey sps! I think it is a pretty interesting solution - even though with some limitations. I was wondering if we could also use the open ai to help with the tokens issues (for example: if the previous conversation is getting larger, than summarize it and input again to the AI conversation)
Effort should be REALLY LOW and probably it is another step towards solving this issue (even though we can get some other better solutions that the one i suggested)
great job