Depending on whether your question involves context, by design, the gpt’s adaptive attention mechanism should help you recall the appropriate part, but beyond that, it may cause forgetting, and the recall rate of gpt is only 100% at 128k
rjywjy
4
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Strategies to feed GPT4 bot with product database to maintain context | 13 | 1389 | December 17, 2023 | |
| How you motivate LLM Agent to read all the data before answer and to work only on the database and answer only based on it? | 8 | 2858 | July 1, 2024 | |
| Prompting with the chat/completions API against a large transcript file | 5 | 3802 | October 4, 2023 | |
| Question answering with extended number of chunks | 13 | 2592 | June 6, 2023 | |
| Best method of injecting relatively large amount of context to be leveraged in a response | 10 | 12968 | December 17, 2023 |