I am using assistant API, I have created assistant from my backend, I have created a thread added message in it and running it using the assistant. When running this thread using assistant API, I am getting a little bit large responses, But when is ask same question with the same assistant in the playground, I got good results that I want.
I think there could be some hidden settings for the playground, So the playground is generating good answers whereas my code backend is not able to generate same results.
Can someone guide me…
I want to make my bot worked same as playground.
1 Like
Check the maximum number of tokens per message setting. When I developed my first assistant I got results similar to what you described. So I started observing the consumption of tokens per message and soon realized that I was not operating at the maximum amount. Check which model you are using in the assistant and the maximum number of tokens for the model.
Aloha