The problem is a lot of context data like Character details, etc is being sent every time a paragraph of the fiction is generated.
So, saving matter a lot.
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| XML vs Markdown for high performance tasks | 3 | 1334 | May 15, 2025 | |
| Should I use YAML or JSON for embeddings text? | 4 | 2115 | December 17, 2023 | |
| Markdown is 15% more token efficient than JSON | 8 | 4180 | June 27, 2024 | |
| Has anyone found that using markdown in the prompt makes a difference? | 5 | 2965 | January 13, 2025 | |
| Using the API? Here's how you can save up to 30% and increase reliability | 12 | 6449 | December 17, 2023 |