Are the input tokens cumalative when the user continues a chat? For example, If the user sends n messages, will I be charged (system_prompt+1+2+3…+n) messages as input tokens per message? Or are input tokens just per message? Many thanks.
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Clarification on token calculations with OpenAi Assistants | 1 | 129 | September 25, 2024 | |
| How is the assistant API charged? | 0 | 61 | February 17, 2025 | |
| A question about assistant token usage | 2 | 350 | May 9, 2024 | |
| About the charge for 1000 tokens? | 2 | 2596 | November 7, 2023 | |
| Does the system message costs per 1k token as well? | 2 | 3493 | June 4, 2023 |