Hello everyone ! The task is to translate a JSON array from Japanese to English. An example of the instruction is below:
Translate to English. Keep the JSON structure the same after translation. Return just the JSON, without any text around.
An example JSON is below:
I notice that with a relatively small size of the array and the elements themselves, the translation through the API (Chat completions gpt 3.5, gpt4o) takes a noticeable amount of time (10-15 seconds). In the web interface of ChatGPT, it works noticeably faster (3-4 seconds). How can I optimize the speed? Are there any OpenAI API parameters that can be adjusted? Or are there special solutions (like other LLMs) for working with JSON? Or should I “give up” and use the good old Google Translate?