Hi, We are developing a SaaS and it’s looking like it might take off quite quickly. We have wrapped Open AI models around it and deployed heavy guns like GPT 4 Turbo. Our concern? $10,000 monthly usage limit (tier 5). I think we are going to smash this within the first month and then what? How do…

Yes, we did consumer tests. We will surpass the $10k very quickly and are not sure what to do next to scale. Is using multiple APIs even an option? Is it within Open AI TOS?

We control the traffic and consumption. Our price plans are based on that. Let’s say you have 1,000 Subscribers and each of them uses an average of $10 a month of our Open AI Limit. How can we scale that above 1,000 users if Tier 5 is capped at $10k?

You can get an Azure account to trigger if the OpenAI one hits the limit, that is one way. Edit: if you have money it might be easier to talk to an Azure rep as if you’ve got something to bring to the table they’re usually easier to get on the phone. They have vendors that can give you better deals…

That is kind of what we are exploring now. I was also wondering if opening multiple accounts and getting them all to Tier 5 would be against Open AI TOS? We could potentially handle this with multiple APIs.

[image] Keplo: I was also wondering if opening multiple accounts and getting them all to Tier 5 would be against Open AI TOS? Yes it is against the TOS. edit: at least I know you’re not supposed to

I am building a vertical SaaS app using the Assistant API and I am planning to launch in the coming weeks (if API speed improves). I am also concerned about hitting the Tier 5 limit. Does anyone know if the latest Assistant API is available through Azure? I just can’t find the information…

Usage Limits for SaaS - Go Above Tier 5

API

anon34024923 December 16, 2023, 4:24pm 4

I’m interested to know what the idea is?

Do you know where your traffic is coming from, have you analyzed that at all?

Topic		Replies	Views
API quota / limits for high volume application API	0	312	May 29, 2024
Using Multiple APIs to Increase Usage Limits API api	1	606	December 16, 2023
Inquiry About Maximum Rate Limit for GPT-3.5-turbo-16k Model API api-rate-increase , rate-limit	7	1181	November 1, 2023
My hate for the usage limits API	6	1792	August 15, 2023
Question regarding cost, rate limits and monetization of OpenAI in a SaaS product API	4	827	May 18, 2024

Usage Limits for SaaS - Go Above Tier 5

Related topics