How long does it take for your scripts to process the API? For a simple API call, it takes at least 40 to 50 seconds. Is that normal?
I know I should cache my response for similar prompts but unfortunately in my app, there is no repeat prompt. All prompts are unique and I cant cache them. So I have to make real time live api call for each query/prompt.
Thanks in advance