Given your chat has exceeded the context length of the model being used, it would be informative to see an indication of where in the chat the context window begins/ends. This way users could have immediate knowledge of what the model will ‘remember’ and if they need to re-provide some information to the model. Maybe this could look like a popup when you pass the context length and a line in the scrollbar showing where in the chat the cutoff occurs.
1 Like