For clarity, I’m not using file retrieval (or any other tools) as I found file retrieval to be unreliable as you mentioned. (I’m guessing it puts in a vector database, etc., which is not what I want. I need literal, not semantic, matching.) Instead, I use a prompt plus file contents as an instruction. In this particular case, the prompt plus file contents is >32K which makes the API reject it. The instruction in Playground can handle it, just not the API.
I’ll try to use the additional_instruction as you mentioned. Hopefully when the instruction + additional_instruction is over 100k but under the limit of the model, it will still work. This seems like a work-around but whatever works…
Thanks.