How fast are custom GPTs at accessing uploaded knowledge store documents?

[scottermonkey]

@scottermonkey

I have an Enterprise level client who wants to train an LLM to handle a few aspects of their customer relations.

It seems fine-tuning is limited to =< GPT 3.5 turbo. What are some alternatives to fine-tuning if I want to use the latest GPT? I know with gpt-4-1106-preview, it has a larger context size than gpt-4 and the ability to upload documents to a “knowledge store,” and I know of how I can create a specialized “GPT” in OpenAI’s web interface, give it that knowledge store of documents, and then access it via API. How good are these custom GPTs in terms of speed of accessing their knowledge store? How expensive to use? Is it even the path to go? Ideas?

It would help if I understood what you meant by “The way I use this feature is to upload swagger/openapi definitions or large data structures, and it will load it whenever I ask it to make a serializer function for a particular type.”