Hello, I know this is a known problem but maybe someone happened to know a workaround or solution for this. I am using the model gpt-3.5-turbo-1106 model as an assistant, its task is to extract a value from input text and if it is not there ask the user to either enter ‘1’ for option 1 or ‘2’ for …

[image] minaabdelmassih57: I am using the model gpt-3.5-turbo-1106 model as an assistant Do you mean you use gpt-3.5-turbo-1106 IN the Assistants API? If so, Assistants API is still in beta and is highly uncontrollable.

There is absolutely now way to do the full cycle of prompt engineering in the playground. What seems to be getting good results in playground will turn out a nightmare in production as you cannot possibly do hundreds (and sometimes thousands) of test of a prompt. If you haven’t done so, you haven’t …

How do you suggest I should test the prompt and the assistant then? Also, shouldn’t the results be somewhat similar between the playground and the production? Given that I am using the same model and same instructions. Also, I am aware that manual testing the prompt is not a reliable way to valid…

LLM’s are stochastic by nature, meaning that if you tested a prompt 10 time and it seems to be working right, doesn’t mean that on the 11th the result will still be the same. For the LLM apps that require predictability of results you have to do mass testing (from what I see everyone is using their …

I have a similar problem and it seems to get worse as the thread gets longer. The Assistant just ignores the instructions passed to it. I want to specify certain formats for certain messages and it doesn’t work in the assistants API whereas it does if I take the messages from an assistant’s thread a…

And back to my point - Assistants API are still in beta and even a robust prompt engineering process won’t make them follow your instructions perfectly.

What I found useful is sometimes to break the instructions into smaller tasks and assign each task to an assistant, it was less likely to fail in that case and it had clearer instructions compared to having one Assistant do all the work with a lot of instructions to do and different cases to handle.…

Have you tried to not use the assistant but a simple script to proceed with the conversation? Instead of sending the user reply with 1, 2 or anything else back to the model you run a script to check the user message and then return to the assistant with “The user wants Option 1” or return to the us…

The opposite of helpful. Obviously it’s beta, I’m pointing out difficulties I’ve had to see if people have workarounds or other practices to accomplish the same task.

Assistant Not Following Instructions

API

minaabdelmassih57 December 19, 2023, 9:10am 3

First, I use it in the Playground and then after I am done perfecting the instructions and testing the assistant and its replies I get the assistant key and my API key and use it from the API.

Topic		Replies	Views
Inconsistent results from Assistant API bug , assistants-api , assistant	7	1691	February 22, 2026
Assistant API is not aware of its instructions API assistants , assistants-api	15	3957	June 26, 2024
Assistant shares excessive information from the prompt Prompting assistants-api	11	464	April 29, 2025
Assistant thread instructions work better than assistant's instructions themselves API assistants-api	3	1297	February 22, 2026
Why is the Assistant not following instructions? And other fairly serious issues API assistants-api	7	555	July 18, 2025

Assistant Not Following Instructions

Related topics