Structured Outputs Error calling OpenAI:
Could not parse response content as the length limit was reached - CompletionUsage
This is the error log:
(‘Could not parse response content as the length limit was reached - CompletionUsage(completion_tokens=16384, prompt_tokens=40482, total_tokens=56866, completion_tokens_details=CompletionTokensDetails(accepted_prediction_tokens=0, audio_tokens=0, reasoning_tokens=0, rejected_prediction_tokens=0), prompt_tokens_details=PromptTokensDetails(audio_tokens=0, cached_tokens=40448))’,)
2025-03-05 10:15:36.388 | ERROR | Error calling OpenAI: Could not parse response content as the length limit was reached - CompletionUsage(completion_tokens=16384, prompt_tokens=40482, total_tokens=56866, completion_tokens_details=CompletionTokensDetails(accepted_prediction_tokens=0, audio_tokens=0, reasoning_tokens=0, rejected_prediction_tokens=0), prompt_tokens_details=PromptTokensDetails(audio_tokens=0, cached_tokens=0))
=================================
This is the code
from openai import AsyncOpenAI, OpenAIError
client = AsyncOpenAI(
api_key=LLM_API_KEY,
base_url=LLM_MODEL_URL,
)
completion = await client.beta.chat.completions.parse(
model=LLM_MODEL_ID,
messages= messages,
response_format=response_format,
temperature=0,
)
Who have you ever faced this issue? If you have any solutions, please let me know soon.
Thanks