Infinity Memory implementation

In that case you can let the model use the function to retrieve relevant conversation with embeddings and/or a vector DB, if there’s no answer available in the current list of messages, while also deciding the indices of messages to remove from the message list, to conserve tokens.

There aren’t any laws for that. Just make sure you’re not going over your org’s rate limits, else you’ll get rate-limit error