Hi all,
One major benefit of using Summary method for context in Conversation is to save cost. But with increasing chat iterations, no of token keeps on increasing, significantly.
Is there any parameter, by which I can set the max limit of Summary?
1 Like