There you have it… prompt_tokens are also billed and max_tokens is for generated answer only - completion_tokens
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Max_tokens seems to do nothing for me 3.5 Turbo | 14 | 3309 | December 18, 2023 | |
| Creating Concise AI Replies in Short Interactions without max_tokens | 10 | 2102 | March 12, 2024 | |
| MAX TOKENS is 4,096 tokens for gpt-3.5-turbo should fit the the messages sent and the answer generated? | 10 | 6149 | December 18, 2023 | |
| Struggling with max_tokens and getting responses within a given limit, please help! | 5 | 18769 | October 28, 2023 | |
| Setting max tokens for output issues | 4 | 3570 | January 26, 2024 |