- Thanks OpenAI for releasing this great product, and great affordability.
- Many user has question about conversation session, session ID, chat history…
- I am learning how to tune ChatGPT AI for specialized purpose , such as (AMA session, customer service)
- Currently Openai 3.5-turbo (chatgpt API) not allowed to fine-tuning
Here is my interesting finding :
You can see the 2,3,4 API call, the Token Total is NOT equal to Prompt + Completion.
( Because for every user entered Prompt, I have “inserted” my context for this conversation (about 2874 characters )
But, it seem the repeating context I inserted, Do not factor in final count of Total Token.
i will test if input large amount of context, and carry forwant the context in every user prompt ( in same browser session )
How will it affect the token calculation.