I opted in for the “sharing prompts and completions with OpenAI” for the free tokens, and I ended up having issues with response speed of the API.
I’m developing a web app where the sequence of about 10 api calls ended up taking about 3-4 minutes to finish rather than the usual 1.5 minute or so. I was trying to figure out if I changed something in my code or if the model had been updated to point gpt-4o to some new snapshot, but that wasn’t the case.
I finally noticed when the daily free token limit had been exceeded, and the response of the api for app suddenly increased as I mentioned earlier.
I couldn’t find any mention of this option making the responses slower, so it was quite a surprise, and I ended up using quite a lot of time trying to troubleshoot the issue.
Has anyone else had the same experience? I also just wanted to get this out there in case someone else is having a similar issue with their app.