Chat improvement delete unneeded responses from the conversation

Prompting
1

I think it would be great if during a session I could delete chat responses I dont need to keep the system from getting confused about what I want to talk about

5 Likes
2

This is a feature in the API but isn’t really viable for chat solutions.

1 Like
3

The thing is that often the chat will produce responses or code that is misleading, and its obvious that the functional working memory of gpt is much smaller than the chat if your working on developing a solution or topic. being able to clear out useless stuff from the discussion to keep the focus on the topic would be great. Just my experience. Or even better have two windows where you can push a button and keep the info important to the discussion topic and then have a running window for the discussion that you can push save on when the results are good. Like your writing the story and you have detailed descriptions of the characters you don’t want to forget about.

2 Likes
4

being able to clear out useless stuff from the discussion to keep the focus on the topic would be great.

That’s a pretty good idea. Most “non-consumer” user interfaces do that. (e.g.: the openai playground: https://platform.openai.com/playground/chat?models=gpt-4o, the anthropic playground, the google vertex playground, etc.)

Note that with those you typically pay per token input and output, instead of a monthly subscription.

The other stuff you describe seems pretty useful, but not that hard to implement. I wonder if there’s some UI out there that already does this :thinking:

I keep hearing things about sillytavern but I’ve personally never tried it out. There seems to be a solid ecosystem of avid users around that.