A question about assistant token usage

API
1

Hello, folks. I am currently experimenting with assistants and have not been able to fully understand how it calculates the number of tokens. Each time I execute a message, the token count increases, and what I am unsure about is:

  1. Is it the cumulative number of tokens I have used in this thread?
  2. Or is it the number of tokens that was used in the previous execution?

스크린샷 2024-04-01 오후 12.42.10

1 Like
2

I have the same question. Confusing as token usage seems pretty unpredictable.

Based on my numbers I would guess (and hope) that its cumulative across the thread, but im not sure.

Any help would be appreciated here!

3

@_j are you able to answer whether or not these token counts are cumulative across runs, pr per run?

thanks!