Are the input tokens cumalative when the user continues a chat? For example, If the user sends n messages, will I be charged (system_prompt+1+2+3…+n) messages as input tokens per message? Or are input tokens just per message? Many thanks.
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Clarification on token calculations with OpenAi Assistants | 1 | 55 | September 25, 2024 | |
| A question about assistant token usage | 2 | 336 | May 9, 2024 | |
| Are we repeatedly charged for all tokens in the context window? | 4 | 295 | May 30, 2024 | |
| About the charge for 1000 tokens? | 2 | 2498 | November 7, 2023 | |
| Does the system message costs per 1k token as well? | 2 | 3266 | June 4, 2023 |