Inferencing costs are different from LLM development costs. The former will continue to drop to the point where the cost of providing an inference will be less than the cost of accounting and billing for them. The latter will continue to plummet, as witnessed in the LLM open-source communities.
That’s good. It’s wonderful that OpenAI (and other commercial ventures) find customers willing to pay for these services. However, there will soon come a time when the economies of scale and use cases will alter consumer demand. Switching costs will be pretty low and possibly near zero.
Plugins have their place, but those places will quickly narrow. Determining where plugins work best is shaped by three business drivers. You can’t have a ten-minute latte break at Starbucks without overhearing a conversation about GPT Plugins and how they will revolutionize customer experiences with brands and real-time data.
These grandiose AI visions in a web context represent extremely early, deeply flawed assertions. Here’s why…
Brand matters . Businesses know that customers care about brands which serve as signals for quality and trust .
Security and privacy matters . Despite all the security measures that may be possible with GPT Plugins, the perception of security and privacy will be difficult to convey.
Entities matter . Customers don’t telegraph this requirement, but in matters of information, they care deeply about who [exactly] they are getting advice from.
To overcome these challenges, OpenAI Plugins must provide an experience that quells these customer-sensitive requirements.
Businesses need a cake that customers want to eat. GPT Plugins are Cannolies; businesses and their data are the creme-filling.
There’s nothing inherently wrong about GPT Plugins wrapped around your tasty business data and processes.
This is why GPT Plugins will be very successful. It’s akin to the success of the pay-for-click model that Google used to dominate knowledge discovery for so many decades. However, because we don’t complete our travel arrangements in the context of a Google search result, we also may not desire to use GPT Plugins to engage in commerce.
We will taste the delightful creme-filling of integrated AGI with our brands, our data, and even our personal knowledge base. However, the cake will probably be eaten elsewhere.