Are the input tokens cumalative when the user continues a chat? For example, If the user sends n messages, will I be charged (system_prompt+1+2+3…+n) messages as input tokens per message? Or are input tokens just per message? Many thanks.
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Clarification on token calculations with OpenAi Assistants | 1 | 135 | September 25, 2024 | |
| How is the assistant API charged? | 0 | 65 | February 17, 2025 | |
| A question about assistant token usage | 2 | 352 | May 9, 2024 | |
| About the charge for 1000 tokens? | 2 | 2611 | November 7, 2023 | |
| Does the system message costs per 1k token as well? | 2 | 3547 | June 4, 2023 |