ChatGPT prompt length issues


I have designed a chatbot LLM with text-to-SQL capabilities for a specific domain of data. However, I notice that to handle the nuances of the data, I need to keep adding more and more stuff to the prompt.

The prompt has become very big and time consuming.
How could I improve on the prompt length and time?