Hi Team,
I would like to understand the pricing structure for “gpt-3.5-turbo-0125” given that I have 80 million tokens per month for input, with 8 million as output tokens. Could you please explain which tier this falls under? Additionally, could you provide an estimate of the monthly pricing?
Hi and welcome to the Dev community!
To clarify, the API is not a subscription, it’s pay-as-you-go based on input and output tokens.
The subscription plans for ChatGPT are an entirely separate product that doesn’t connect to the API in any way.
As for an API account, you can find the pricing on this page. Using your example of 80 million input tokens and 8 million output tokens (not sure where you got these figure from??) the costs would be as follows:
Model: gpt-3.5-turbo
Input: $0.50 / 1M tokens
Output: $1.50 / 1M tokens
80 * $0.50 = $40.00 for input tokens
8 * $1.50 = $12.00 for output tokens.
Thank you for your response.
Currently, I have some text containing information. I need to extract additional details in JSON format from this text, as specified below. If I have similar text every month, totaling one lakh instances, can you please provide an estimate of the cost? My management team needs this information to budget accordingly. Could you please explain the pricing based on the text I’ve provided?
I have also included the API response and request for your reference.
Command Input →
input_text = “I want to statically extract the Invoice Number, Date of Expenses (in the format DD-MM-YYYY), Amount, Currency(check in response if any symbal is coming return as String currency name), Merchant Name, Category, Tax Amount, and Tax Percentage keys from this text. Could you provide them in JSON format? The JSON object format is as follows: {‘Invoice Number’:‘String’, ‘Date of Expenses’:‘String’, ‘Amount’:‘Double’, ‘Currency’:‘String’, ‘Merchant Name’:‘String’, ‘Category’:‘String’, ‘Tax Amount’:‘Double’, ‘Tax Percentage’:‘Double’}.”
response = openai.ChatCompletion.create(
model=“gpt-3.5-turbo-0125”,
messages=[
{“role”: “user”, “content”: input_text},
{“role”: “system”, “content”: extracted_text}
]
)
============================================================
Extracted text: extracted_text which i have sent in api parameter
Prabhakaran C
NA
Mini - Silver Indigo
Ride Details
03:42 PM
TAFE, Nungambakkam High
Road Ponnangipuram
Tirumurthy Nagar
Nungambakkam Chennai
Tamil Nadu India
03:50 PM
VDS House, 41, Cathedral
Rd, Ellaiamman Colony,
Teynampet, Chennai
Your Trip
₹129.12
Total Bill (rounded off)
Includes ₹9.12 Taxes
₹129
Have queries? Visit support for this ride.
We’ve fulfilled our promise to take you to
destination for pre-agreed Total Fare. Modifying
the drop/route can change this fare.
Bill Details
Paid by OlaMoney Postpaid
₹129
29 Apr, 2022
₹129
CRN6215232412
Thanks for travelling with us, Benny Robertson
Payment
Original Tax Invoice
Driver Trip Invoice
Prabhakaran C NA
Ola Mini - Silver Indigo
TN11S3675
Operator State/UT: Tamil
Nadu
Service Tax Category: Renting of motor
cab
SAC Code: 996412
Invoice ID DIOTGKWFO313168
Invoice Date 29/04/2022
Customer Name Benny Robertson
Mobile Number +919940033732
Pickup Address TAFE, Nungambakkam High Road
Ponnangipuram Tirumurthy Nagar Nungambakkam
Chennai Tamil Nadu India
Description
Amount (INR)
Customer Ride Number - CRN6215232412
Ride Fee
₹96
CGST
2.5%
₹2.4
SGST
2.5%
₹2.4
Subtotal
₹100.8
Total
Customer Ride
Fare
₹100.8
Please note: 1. This invoice is issued on behalf of Transport Service Provider. ANI Technologies Private Limited acts in the capacity of an Electronic
Commerce Operator as per Section 9(5) of the Central Goods & Service Tax Act, 2017 & corresponding Section 5(5) of the State GST laws. 2. This is an
electronically generated invoice and does not require a digital signature.
Original Tax Invoice
ANI Technologies Pvt. Ltd.
ANI Technologies Pvt.Ltd, 18-A, SIDCO
Industrial Area, MMDA Bus Terminal,
Arumbakkam,Chennai
State GSTIN: 33AAJCA1389G1ZQ
SAC Code: 999799
Service Tax Category: Business Auxiliary
Service
Invoice ID CIOTGKWFO313168
Invoice Date 29/04/2022
Customer Name Benny Robertson
Mobile Number +919940033732
Supply Address ANI Technologies Pvt.Ltd, 18-A, SIDCO
Industrial Area, MMDA Bus Terminal,
Arumbakkam,Chennai
Description
Amount (INR)
Ola Convenience Fee - CRN6215232412
Convenience Fee (Ride)
₹24
CGST
9.0%
₹2.16
SGST
9.0%
₹2.16
Total
Convenience Fee
Fare
₹28.32
Payment Details
Paid by
OlaMoney Postpaid
Transaction date
29 Apr, 2022 03:50 PM
Amount
₹28.32
Reference Id
6800184a-a7a8-42f2-bccb-46d0433dffe2
Please note:
==============================================================
Additional keys extracted from the text using OpenAI’s GPT-3.5-turbo model:
{
“Invoice Number”: “DIOTGKWFO313168”,
“Date of Expenses”: “29-04-2022”,
“Amount”: 100.8,
“Currency”: “INR”,
“Merchant Name”: “ANI Technologies Pvt. Ltd.”,
“Category”: “Transportation Service”,
“Tax Amount”: 4.8,
“Tax Percentage”: 5.0
}
The total of text of EVERYTHING you have posted is 1135 tokens. Even if it was all output instead of the lower price of input, the total cost to run this job would be under $0.002.
The API billing for actual use will be taken out of prepaid credits, where you must fund your account first with a minimum purchase of $5.
You are misusing the messages roles. You’ll likely need better prompting instructions than you demonstrate, first telling the AI what its purpose and task is in a system message, and then a user message with the data, where “user” then provides the exact processing instructions to accompany the information.
The extracted text is derived from an image, and I only need to extract additional keys from that text. As mentioned above, I have provided an example of text extracted from an image. Similarly, every month, I have 100,000 instances of extracted text. I need to read the additional keys mentioned in the input. I want to know the cost of extracting those additional keys from the extracted text.