I wondered, how many api requests OpenAI has to process per day in total and searched the web and asked ChatGPT, but didn’t find any number.
Does anyone know the estimated number, how many api requests OpenAI has to process per day? And how this value changed in the last months?
I appriciate any reply. Thanks in advance.
Tom
Welcome to the community!
I guess around fifty-thousand per day ( from random people messing around not from companys ), but there is no set evidence as @Foxalabs says here:
Hi and welcome to the Developer Forum!
This information is not public domain, so anything would approximation and guesswork.
One can make some fairly simple assumptions that place the ChatGPT userbase at approximately 500,000,000 with perhaps 10-100 transactions per day per user for a total of 50 billion to 5 trillion per day, then on top of that would be any API based usage, that would be a total guess, say another 10-50 billion a day.
it could be 1/100th that or 10,000 times that… speculation is a fun game though.
Wow, with a 500,000,000 user base. I could speculate that 1/10,000 actually are active and use the API.
So let’s say 50,000 use the API daily. Some big companies probably make upwards of 100,000 while smaller only around 10.
Let’s say 25,000 requests average per. [ probably too high ]
Equaling 1,250,000,000 per day.
But as Foxabilo said it can only be estimated.
Indeed, I think the real number in terms of tokens is in the trillions, and only growing, I am fairly certain that OpenAI is the major share of all LLM processing done at the moment and the user base both from industry and privately is only growing day by day.
I think it no underestimate to say that AI will quickly become the largest use of datacentre compute and that compute is going to grow on the order of a 100K - million x per year for at least the next few years as investment and usage rises.
Thank’s all for the replies.
But to clarify the topic: I’m only interested in the amount of the paid API calls via the corresponding interfaces like api. openai. com /v1 /chat /completions. The use of the free services as ChatGPT is probably 10K to 100K times higher.
Do you have the answer now? I’m also very interested in this question.
No other answers than these here in this thread. I think there are no official numbers to get.
There are real stats on this now. Total number of Active users per month is ~100M. Pages (session) view per month is 1.7B. Avg pages (not queries) is 1.4/visit. Question : How many queries per session for active users? I heard some outrage estimates of 25/day . I work in an IT group and polled my colleagues and the average was less that 5 queries per day. I believe the general public would be much less than that.
I would say that queries per day was way too high. From: meetanshi-dot-com
/blog/chatgpt-statistics, as of June 2024, " Over 180.5 million people have created an account on ChatGPT, but only around 100 million/week are actively using it. " from: demandsage-dot-com /chatgpt-statistics, (May 2024) Pages (not queries) per month is 1.7B. Avg pages per visit is 1.38. If you do the math, only 0.78 pages are opened per day by active users. So, once an active user opens a page, how many queries are they likely to make ina day? My IT collegues who are pretty savvy say < 5 queries when they do open up a page.
We are not privy to internal data, but if someone opens up the page they are likely to ask a question, for some that will be enough, many take advantage of the iterative refinement nature of generative AI to drill down or correct misunderstandings.
For those that know it exists, I’m sure they use it as often as is needed. My guess would be some number >1 interaction per day up to several hundred for peak users… take some modal of that and I think it lies in the 1-20 range.