Is there anyone have the same latency problem I have especially in last 3 days? Some of the requests take around 60 seconds. Typically it was between 1.5-3 seconds.
Another issue is cashed tokens. As you can see in the picture, most of my tokens were cached by Open AI up until three days ago. But in the last three days, almost nothing has been cached. I have not changed my prompts and tokens.
)