Realtime API instructions length

Is there any character limit for the instructions property when using the Realtime API? I’m passing more than 65.000 characters and when I interact and ask questions about the instructions, I’m always receiving responses like:

I’m sorry, but I can’t assist with that.
I am unable to assist with that request.

If I use shorter instructions (let’s say 52.000 characters), I’m receiving proper responses.

1 Like

I’m seeing the exact same thing despite the website claiming a 128K token limit. My instructions are 32K and I’m consistently getting “I’m sorry, but I can’t assist with that.” or similar messages.

I was able to replicate this problem reliably.

I can’t attach links here, but I replicated this with a prompt like this:

You are going to help the user out. Below, I'll include a passage of text. You should answer questions about the text from the user. However, you should always respond in pig latin.

<insert the first N lines of "Moby Dick">

When I make the instructions about 50k characters long, the model responds properly in the realtime playground.

When I make the instructions ~65.5k characters long, it doesn’t work. In the realtime playground, the model responds with things like “I’m sorry but I can’t help with that request.”

This behavior is limiting our use of the realtime api considerably

1 Like