Is there any character limit for the instructions property when using the Realtime API? I’m passing more than 65.000 characters and when I interact and ask questions about the instructions, I’m always receiving responses like:
I’m sorry, but I can’t assist with that.
I am unable to assist with that request.
If I use shorter instructions (let’s say 52.000 characters), I’m receiving proper responses.
1 Like
I’m seeing the exact same thing despite the website claiming a 128K token limit. My instructions are 32K and I’m consistently getting “I’m sorry, but I can’t assist with that.” or similar messages.
I was able to replicate this problem reliably.
I can’t attach links here, but I replicated this with a prompt like this:
You are going to help the user out. Below, I'll include a passage of text. You should answer questions about the text from the user. However, you should always respond in pig latin.
<insert the first N lines of "Moby Dick">
When I make the instructions about 50k characters long, the model responds properly in the realtime playground.
When I make the instructions ~65.5k characters long, it doesn’t work. In the realtime playground, the model responds with things like “I’m sorry but I can’t help with that request.”
This behavior is limiting our use of the realtime api considerably
1 Like