We are developing a SaaS that will work with ChatGPT and offer it to our customers.
We plan to offer this service to several hundred organizations with ChatGPT’s GPT-4 model.
Since each organization has hundreds to thousands of employees, it is very likely that the GPT-4 model rate limit of 40k TPM and 200 RPM will be reached frequently.
Normally, we think that users are applying for the GPT-4 model on Waitlist. For a SaaS provider like us, the challenge is that the rate limit is quickly reached with a single API key because the users are in a state of flux.
Is it necessary for us SaaS providers to register on behalf of our contracted customers with Waitlist and issue hundreds of API keys for them to use?