Hey, thanks for offering to help. The code that creates the prompts is really complex at this point and I don’t think it makes sense to publish it. What it does, in brief is pack some basic instructions into the system prompt, take a document that describes the application and the strings to be translated into user prompts, together with the epilog.
The epilog is the most important thing here, because this is the only place that contains the instructions for processing.
My code does token estimation and packs the strings into batches, so that the entire request fits within the token limit, so explanation (1) does not apply. I also use a lower token limit because the GPT-4 API has trouble responding to larger requests because of its slowness. My total token counts (as returned by the API) are around 5500 tokens. The code is also fairly well tested at this point and I know that (2) doesn’t apply.
Causes (3) and (4) are quite probable, and I would be very grateful for any suggestions you might give.