Yes, instead of embedding the entire product catalog into the system prompt, you can develop an interface that links GPT 3.5 Turbo with an external data source. This interface can query the external source to retrieve the relevant information and present it to the user as needed. In this way, you don’t have to load all the data into the model’s prompt.
You can use function
Alternatively, you can also train the GPT-3 model on your data, which in my opinion, might be a more cost-effective solution. In this way, you don’t have to load all the data into the model’s prompt.