-
I feel that openai doesn’t quite resemble a DDoS attack, but rather there seems to be an issue with the JSON mode. If the configuration is incorrect and continually sends the space key, it’s extremely irrational. Despite token-based billing, it greatly results in resource waste.
-
JSON mode + tool_calls[auto]: This could result in a reply being repeated multiple times, which also causes wastage of resources.
For instance:
User: How’s the weather today?
Assistant: tool_call for weather interface, but if the weather query fails, a failed result is received.
Assistant: I’m sorry, I am currently unable to fetch the weather details. Would you like to inquire about something else?
Assistant: tool_call to use a browser to search for the weather, if it fails again.
Assistant: I’m sorry, I am currently unable to fetch the weather details. Would you like to inquire about something else? I’m sorry, I am currently unable to fetch the weather details. Would you like to inquire about something else? (Two identical responses in a row.)
It feels very unreasonable, and although it’s token billed, it greatly leads to resource wastage.