I’m wondering if now that we can switch to assistants, do the messages that were previously sent in a thread still count as tokens with each message sent to the assistant? Previously when I built my own conversation history and sent it via the api they counted as tokens, I’m curious if that changes…

Do assistants count messages in the thread against the tokens limit?

vhpoet November 7, 2023, 11:43am 2

There’s already a conversation here.

1 Like

Topic		Replies	Views
Assistant API response messages + token count API assistants , assistants-api	6	2366	December 17, 2023
Do Assistants' instruction values consume tokens? API assistants-api , assistants-pricing	4	1717	December 17, 2023
A question about assistant token usage API assistants-api	2	348	May 9, 2024
Does Assistants API save cost for back-and-forth conversation? API assistants-api	4	2531	December 16, 2023
Do Assistant-called function outputs count towards input tokens? API	8	1925	January 12, 2024