I’m wondering if now that we can switch to assistants, do the messages that were previously sent in a thread still count as tokens with each message sent to the assistant? Previously when I built my own conversation history and sent it via the api they counted as tokens, I’m curious if that changes…

Do assistants count messages in the thread against the tokens limit?

vhpoet November 7, 2023, 11:43am 2

There’s already a conversation here.

1 Like

Topic		Replies	Views
Assistant API response messages + token count API assistants , assistants-api	6	2303	December 17, 2023
Do Assistants' instruction values consume tokens? API assistants-api , assistants-pricing	4	1650	December 17, 2023
A question about assistant token usage API assistants-api	2	332	May 9, 2024
Does Assistants API save cost for back-and-forth conversation? API assistants-api	4	2436	December 16, 2023
Do Assistant-called function outputs count towards input tokens? API	8	1844	January 12, 2024