I’m having a hard time getting my RAG assistant to be concise. I’ve tried emphasizing in the assistant instructions that it should shoot for responses of 1-2 paragraphs and told it to be concise, succinct, direct, to-the-point, etc. - but it still almost always spits out walls of text that are 5-6 p…

Giving it a length range in tokens worked for me (I.e. Make it 25 to 30 tokens long).

Any way to control assistant verbosity?

anon22939549 January 16, 2024, 8:41pm 4

Asking for an “executive summary” might work too.

It would be helpful though to be able to see the an example of an actual prompt you are using to pinpoint where it is going astray.

3 Likes

Topic		Replies	Views
Making Completion Responses Longer API	4	2234	December 17, 2023
Setting max tokens for output issues API gpt-4 , api	4	4244	January 26, 2024
Instructing GPT3 to generate short answers for chatbot Prompting	6	1744	January 25, 2023
Increasing verbosity towards end of structured response Prompting	3	637	June 22, 2021
Fixed word count Prompting	20	8820	December 18, 2023