Tokenizer and playground calculated a mismatch between the number of tokens and the bill for text-Davinc-003

Thank you very much for your patient answer. I tested it again and found that the calculation of tokens is still inaccurate.

It can be seen that the tokens of the question are accurate, and 14 tokens are consumed

But the answer is wrong, a total of 88 tokens, 88-14=74, the bill shows 14+60=74


here is the bill

This is playground

The calculation is correct for normal text, but wrong for code calculation

1 Like