I am building a gpt-4 chatbot that helps the user complete a process, using functions for each step of the process, I have a large number of ~20 different functions in the prompt plus the chat history which keeps growing at every step and therefore usage costs are growing exponentially. Can you suggest any best practices or techniques to handle such scenario without breaking the bank?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Strategies to reduce conversational GPT-4 costs | 1 | 1143 | May 8, 2023 | |
| Optimization of large requests to GPT | 1 | 1588 | November 24, 2023 | |
| Best strategy for running long almost fixed prompts on a large number of samples | 0 | 547 | February 1, 2024 | |
| Optimize prompt for parallel function calling | 0 | 689 | April 17, 2024 | |
| ChatGPT prompt length issues | 0 | 376 | May 10, 2024 |