I have a table in a MySQL database with 300K records, and I plan to build a chatbot that accepts natural language queries, turn that into SQL, queries the database, and comes up with the results. Does the data volume affect the OpenAI API consumption?
What are some optimisations I can do to minimise the API calls? One idea I thought of is to save all the questions and their corresponding SQL queries. Whenever a person asks a natural language question, use the saved SQL query instead of generating a new one. Any other ideas from people who tried text to sql?