Currently, long chats take up a lot of resources and typing a new prompt is a huge pain. It’s painfully slow and the response is even slower.
A chat that is being used for months does not need to have the entire history loaded at once. It would be a lot better to grab the last ‘x’ number of messages and display them.
If the users do want to see the old messages, these should be retrieved when they scroll towards the top. Again, only a few messages at a time.
It’ll save a lot of resources on the device and make the process a lot faster.