I’m wondering if now that we can switch to assistants, do the messages that were previously sent in a thread still count as tokens with each message sent to the assistant? Previously when I built my own conversation history and sent it via the api they counted as tokens, I’m curious if that changes…

Do assistants count messages in the thread against the tokens limit?

vhpoet November 7, 2023, 11:43am 2

There’s already a conversation here.

1 Like

Topic		Replies	Views
Assistant API response messages + token count API assistants , assistants-api	6	1492	December 17, 2023
Do Assistants' instruction values consume tokens? API assistants-api , assistants-pricing	4	1057	December 17, 2023
A question about assistant token usage API assistants-api	2	197	May 9, 2024
Does Assistants API save cost for back-and-forth conversation? API assistants-api	4	1564	December 16, 2023
Do Assistant-called function outputs count towards input tokens? API	8	1252	January 12, 2024