For TPD limits, is it applied to input or output or input + output?
Also images count towards the tokens correct?
Thank you
For TPD limits, is it applied to input or output or input + output?
Also images count towards the tokens correct?
Thank you
Welcome to the Forum!
Both.
Correct.
Thank you.
Another question, how does cached token come into the equation here?
assuming 1 cache stays active the whole day, do we just count its tokens once when setting, or do we include the read token in the TPD?