Hi Brandon,
I went through the same issues a few weeks ago while feeding a json file containing a list of customers. I made a number of tests and came to the conclusion that the model can’t just be used by feeding it a mass of data in the hope I’ll be able to query it in natural language. It feels like the model has human like limitations (lazyness and untrustable memory ). However, the model is great at programming so what I ended up doing is asking it to create a SQL query I can then pass to my DB to retreive the exact information I’m looking for.
So instead of loading my full customer list to the model and query it for the number of records I have (this generates random results), I asked the model to create a SQL query to retrieve that info after giving it the column and table names I’m using. After asking the number of clients, I now get something like [RequiredActionFunctionToolCall(id=‘call_rUqU2RzOrC’, function=Function(arguments=‘{“query_string”:“SELECT COUNT(*) FROM Clients”}’, name=‘executeQuery’), type=‘function’)]. That’s just an example since I can now query basically any available information on specific records or the whole table.
Hope this helps
Pascal