When sending a message to OpenAI chat api does it add json special characters ex. "{" to the final amount of prompt_tokens?

[backroot]

@KingOfPeru
I hope my post is helpful.

What is the reason for adding total 7 tokens?

A total of 7 tokens are added in the OpenAI API sample code below. Please tell me the reason and calculation logic. OpenAI API Sample Code tokens_per_message = 4 # every message follows <|start|>{role/name}\n{content}<|end|>\n Why 4 tokens? “<|start|>{role/name}\n{content}<|end|>\n” is not 4 tokens. num_tokens += 3 # every reply is primed with <|start|>assistant<|message|> Why 3 tokens? ”<|start|>assistant<|message|>” is not 3 tokens.