Here, I’m working with moderation model. I found this model is free but it still has rate limit. Since this model doesn’t return the tokens used with the response how can I know that I’m reaching limit or not? or even number or tokens that I used?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Can i get how many tokens i have with api? | 2 | 842 | December 19, 2023 | |
| Token count for completion call? | 6 | 2228 | December 19, 2023 | |
| Any API end point to display token usage for the query | 5 | 1792 | January 20, 2023 | |
| How can we count the used tokens in a conversation? | 2 | 5276 | May 17, 2023 | |
| Is max token limit per endpoint or model? | 1 | 1559 | June 29, 2023 |