Completions API slow and actually unreliable when outputting json

API
1

I wanted to generate a meal plan for my users, around 2000 calories. Without outputting in json, its good and hits around this 2000 calorie limit. But when instructed to output json (yeeees im doing it right), first of all its terribly slow, and second of all, it NEVER is even close to 2000 calories. unreliable. waste of money.

1 Like
2

Hi and welcome to the Forum!

Perhaps you could share a few more details about your prompt? This would help to identify what might be causing the issue.

3

For the system prompt, im saying to export in json, that i need a mealplan of about 2000 kcal, and it should be 3 meals a day. with gpt 3.5 it takes about 25 seconds to generate, and 55 seconds for gpt 4. crazy slow. and way below 2000 calories

4

Thanks for clarifying. Unfortunately, absent any further details on current wording of the prompt, it‘s difficult to assist any further. The API response times you are stating do not sound unusual to me given the scope of the tasks.