Does the system message costs per 1k token as well?


I’m looking for clarification on two points related to the API:

  1. Does the system message costs the same as a user message?
  2. Does the API remember a long system message from the first request, or should it be resent each time?

Any insight into potential cost implications would be appreciated.

Thank you.

as far as I know everything is counted… see the example at:

1 Like

System message and user messages are all part of the prompt and charged for as such. API is stateless, there’s no conversation thread or anything. System prompt (and any conversation history you want for context) must be send on each request.

1 Like