AI Copilots Everywhere; GPT's Trillion Dollar Economy

This doesn’t seem to suggest what you’re seeing in terms of app development claims.

Yes, in most cases they make it obvious that it’s only intended as an assistant. Again, this was all originally based on the livestream that I watched, and then my attempt using a different framework and concept. I haven’t used Copilot and can’t say much about it.

I do know that Copilot uses GPT, so anything I say is mainly based off my experience with it; which is: it’s a very powerful tool, but can be misused completely, especially with an incorrect understanding and misrepresentation on how it works. So comments such as “building apps through a conversation” can be misleading.

Ah, okay. We’re on two very different pages.

Copilot for Microsoft Office 365 was announced Tuesday. It is in the hands of 20 enterprises and it uses a very advance collection of prompts and integrations with OpenAI that only Microsoft has access to. They are able to make this claim because their definition of an app based on PowerApp is deeply constrained.

If you had experience building apps with PowerApp, you would know that this is entirely possible with Microsoft’s variant of the term “copilot”. There are wizards and other frameworks that will do this much the way a no-code app works. PowerApps have a limited ceiling and scope of complexity making it an ideal tool to end-cap with an AI wizard.

I believe they will be very successful with this approach, and customers will be far more satisfied than you might assume, especially having never seen it work. One of their test enterprises is my client. They have shared that it truly does build the essential elements of a complete solution.

Is there marketing overreach in their claims? Probably; Microsoft is famous for this. But whatever their claims may be, customers will lap this goodness up in spades and their O365 copilot variant will likely save enterprises millions and win awards.

I have absolutely no experience with Copilot…

I have no doubt it’s wonderful technology and helps a lot of people. I just don’t like these types of claims even if it’s exaggerated for the audience. I’m an old man yelling at the clouds, I know.

I do however have quite a bit of experience with GPT and anything I say is based off of that

As the title of this post indicates, there will be thousands, perhaps millions of “copilots”; you need to add a predicate when using this term now that there are at least two publicly available “copilots”. ;-).

BTW, I’ve built 21 copilots, and 18 are in production. None of them is intended for anything except internal business use. Each one has a discrete name, and they help domain experts perform many different tasks.

I imagine for a lot of cases it is a perfect match.

When I think of application, I think of the whole system. Networking, security, blah blah balh. Which would probably be unnecessary for simple use. So it is a bit of a kick to the shin to see that type of claim when it doesn’t even program well for me in most cases simply by talking, but that’s just my experience with GPT. I understand that Copilot is its own beast

Interesting. What domains and expertise? Would love to hear more.

Regarding Copilots. I am not sure if there will be “thousands” or “millions” of them as my crystal ball is as foggy as yours. But I can relate my own experience with Copilot for Visual Studio Code, which I have used nearly daily for a few months.

I subscribed to VSC Copilot a few months ago and used Copilot nearly daily when writing commercial (paid) Ruby code and sometimes Python as well. It really saved me a lot of keystrokes.

Ofter time, the code completions suggests were a mixed bag. Some were “dead on” and really saved me a lot of time and typos, and others were lines of annoying code-spam. Sometimes I miskeyed and included nonsense companions suggestions which I had to go back and control z which was annoying.

So I had mixed feelings.

Then GitHub notified me that my CoPilot subscription was about to expire and I decided to not renew at the $10 a month charge and let it expire.

Soon after, when coding all those sometimes “very good” and sometimes “very goofy” code completions disappeared (my trial fee subscription expired) and I missed my goofy friend. I realized that I found Copilot very useful at best and a little annoying at worst and even when annoying, often entertaining.

It was like a little bird was coding with me, coming up with ideas, sometime great, sometimes nonsense, but none the less, without the little bird code completions, I felt a bit lonely coding, haha.

So, I reversed my decision and paid the $10 buck a month to keep this companion coder in VSC.

It’s funny to think that I actually “missed” the often goofy auto-completions, the many lines of nonsense; but it’s fun to see the "nonsense’ CoPilot comes up with a times and of course, when it’s “dead on” it’s really, really a productivity booster.

So, It’s easy to image these types of specialized Copilots in all domains, legal, medical, professional writing, marketing, finance and yes the specialization probabilities seem endless.

I hope you @bill.french will post more tech details on the copilots you created and the code,

:slight_smile:

1 Like

Great post; your experience parallels mine and why I tend to ask sceptics - would you feel better, perhaps more confident doing this engineering stuff alone? :wink:

When non-coders get a taste of a copilot experience designed for a specific workflow or information-related task, they will adopt similar sentiments. It is very useful at best, and a little annoying at worst. The net gain will be significant and measurable. They will want more copilots in their work and also in their lives. Ergo - copilots everywhere.

I’ll share two…

Cost Recovery Processing

In a little office in South Carolina, an “agent” is assimilating data from a motor vehicle accident captured by a fire department. It includes a narrative of the accident scene, images of property damage, injuries, and, most importantly, the time, equipment, and materials used to clean up the accident. This information needs to be compiled into a claim and submitted to the drivers’ insurance companies to compensate municipalities for their time and expenses. My “copilot” assists the agent with a variety of time-saving helpers to extract entities from the fire chief’s narrative, entities and data values from the police report,keywords from all of the data, and map geometries from the location address or intersection. The agents doing this work are about 22% more efficient since we implemented this copilot approach. Even in this very early stage and as simplistic as these helpers are, the workers cannot seem to live without them.

Validating AI Performance

I work with a video analytics company that creates real-time highway analytics. The technology uses advanced global shutter cameras and edge devices capable of performing AI to classify, count, and even determine HOV occupancy for vehicles at high speed. This is cutting-edge AI, of course. But there’s another side of this solution that most people assume is 100% manual human effort - validating AI results. Someone has to examine the video to understand and log AI performance. This copilot assists the validation process by using GPT to identify ideal sampling periods, creating reporting narratives from data, and even building key metrics that help the AI team tune their models to improve performance. It compresses the time humans must endure explaining where the AI system is failing or succeeding. It’s a more optimized feedback loop that accelerates knowledge about system performance. Oddly, this copilot is built in Coda.

1 Like

As I’ve suggested … AI copilots are just beginning and will be everywhere.

I’m having a bit of a problem following your generous use the phrase of “millions of copilots” without more context, to be honest @bill.french .

Do you means millions of people will use copilot ? Of course, this is already happening and this is easy to agree with.

Or do you mean, that you predict there will be millions of different copilot software applications (like the VSC Copilot extension) and these individual copilot software applications and projects will be actively maintained and with a user base?

:slight_smile:

That’s what I’m saying. If someone like me - a consultant - is being asked to create a variety of “copilots” (lowercase) for specific domains of work, what can we glean from this early demand and adjacent market observations?

  • Dan Shipper is frequently suggesting where and how copilots (lowercase) will probably emerge.
  • Many of the demos in this community are ostensibly copilots; they serve specific work tasks with GPT.
  • Bardeen is a no-code platform for building AI-enabled data collection processes to serve specific business and professional work tasks. It’s user base is asking for playbooks that utilize GPT to streamline work tasks. Playbooks are ostensibly copilots.
  • Microsoft has demonstrated about a dozen different copilots in its O365 vision; there’s likely to be another dozen before they launch.

We’re in the early days of copilots and the definition is not clear or rigid. Where do you think we’ll be in a year? Three years? Five years? I think it’s safe to predict that copilots of varying complexity and usefulness will be required for every unique work objective to accommodate our demand for AI-assisted productivity.

I’ll admit. I am currently trying out visual code with Copilot - might as well. I was using JetBrains for basically my whole toolset so it’s slightly refreshing.

Are you referring to this (GitHub) Copilot, or the Microsoft 365 Copilot? I am slightly confused.

This article started by referring only to Microsoft’s new (unreleased) Office 365 Copilot as an example of the rapidly expanding notion of paired AI assistants.

When the comments drifted into another copilot named “Copilot” (from Gihub), which is purposed only for code development, we started referring to that copilot as well.

This is why I tried to suggest we be very clear about the predicates used to describe specific “copilots”. A year ago, there was one Copilot from Github. Today, there are many, and each day this number grows. It seems that the idea of a copilot is deeply wanted by many users and for many domains of work - not just coding. As such, the term Copilot is ambiguous and will remain ambiguous from this moment forward.

There was a time when “car” meant Model T. When a friend asks what you drive, a “car” is not a good answer. It may be whimsical or flippant to respond this way, but it is not an answer that carries much meaning.

1 Like

Ah, right. I see.

It’s very confusing. It seems that the phrase “Copilot” is being thrown around as a generic term for AI assistance.

I was initially under the impression that it was the same thing. After looking into it more I see how it is and must say, it all looks exciting. I currently use Google Drive for all my business documents. It’s basically already at the point where I should be able to say “Write a contract using the numbers from this spreadsheet” and probably just some few-shots would suffice. Just imagining the potential is huge. How do you bundle the service and sell it as your own if you don’t mind me asking?

This unreleased version I’m assuming you have early access to?

Indeed, much the way Xerox has been bandied about. :wink:

I assume you are referring to the Microsoft O365 Copilot product. No access yet, but I do have a client (one of twenty testing enterprises) who is using it. And they’re deeply bound by an NDA, of course.

Yes, the dots to make that connection are certainly within reach with LLMs.

As you would any other SaaS service. I am building copilots only under a professional service agreement presently. I need many more miles of experience before I might throw down on a specific offering if at all.

1 Like

Thanks. Great points. I will have to learn more, I’m very happy with GPT, but as you mentioned, the layering and services that Microsoft offers is hard to resist. For my bundling question I was referring to the unreleased product, but now I understand, thank you.

If “copilot” is defined as “AI Assistant”, then yeah, they are everywhere, and millions, hundreds of millions, etc. of them all around the world. Use 'em all the time! It’s the next best thing since sliced bread :slight_smile:

Haha.

I like reading your posts Bill, They are well written and often entertain as you would expect from a seasoned consultant. But at the same time your posts have had me wondering the same thing you mention above. You elegantly talk as IT consultant who is used to advocating tech and promoting ideas, writing with a lot of current-trend buzzwords and links and concepts, but as far as I can see, you have not posted any of your own ‘copilot’ or other OpenAI API-based code in our developers community, not a project, a snippet or a line of code.

I’ve read most of your posts Bill, and enjoy reading them, but at the same time I have found some technical mistakes which you recanted because you said you “read it in a blog post”. This is expected and normal for consultants to read a lot and “talk the talk” but do not actually “eat their own dog food” (write software) as you say because they do not really develop software themselves to have a deep working knowledge of what they are advocating.

For example, you posted a few days back that using embeddings required a vector DB and when myself and @curt.kennedy corrected you, you kindly replied that you “read that in a blog post” and thanked up for the correction.

Don’t get me wrong, we have a lot of armchair quarterbacks here who have read blog posts and marketing blurbs who post here as “developers” when they are actually, “consultants” or “consumers”. There is nothing wrong with being passionate; but “where is the beef?”

Yes, it is easy to see that you are passionate, well read, intelligent and have learned a lot about this domain, that is a fact. I enjoy reading your posts…

Where is actual working code you have developed? Even if every copilot you have written (you said you have written many) is under NDA, you can still easily “whip out” a nice “Hello World” version of a copilot for developers here in Javascript right?

As someone who “does walk the talk”, I have written three OpenAI apps, two Discourse plugins and a large OpenAI lab which dwarfs the playground, so when I reply to questions here, I reply from the perspective of a software developer who has actually written three OpenAI API-based apps, write OpenAI API related code nearly daily, and not from the perspective of a “consultant” who read a lot and learns about the domain. Many of us here are software developers who actually code this stuff, not advocates and consultants selling ideas and concepts.

So, here is the bottom line and please prove me wrong.

I want to write a copilot today. I am a software developer and code daily. Normally I code in Ruby, but I’m OK with many languages, even when I prefer Ruby. I searched the net looking for an example “hello world” or other simple copilot code tutorial and cannot find one.

No matter how I word my google search, it only brings me to more GitHub Copilot related topics, no code, no copilot tutorials, no “how to write a GitHub -like copilot” tutorial to be found, so far in my google searches. Maybe I have not found the right search terms?

In summary, while it is nice to be all “excited” about “millions of copilots”, as we all are, it’s hard to imagine “millions and millions” of copilots programs when, at least so far, I have not yet found a single “hello world” “how to write a copilot” code example on the net.

Would you please do all of us a favor here, @bill.french and write a “hello world” simple “copilot-like” program so we can see how you do it?

Thanks!

:slight_smile:

This is true. I don’t feel that my current level of development competence with LLMs has matured enough to share anything yet. While I’ve used Github’s Copilot for more than a year, all my work with it is for Stream It while developing analytics systems for DOTs, which is hardly relevant to this community. Frankly, it’s boring stuff.

Correct - this blog post swayed me to believe the best approach is to use something like Pinecone. Technically, as you pointed out, it’s not required, but it sure is easier unless you are as deeply skilled as you and @curt.kennedy are in building database systems and have a deeper understanding of math, cosine, etc. Now that I’ve seen both worlds, I would still favor outsourcing for many projects, but that’s just my historical experience kicking in with a decided bias toward scalability.

Available time has not been favourable to me lately. My wife is very ill, and I’m juggling two jobs - one building the software for this, and another as a consultant trying to pay medical bills.

Yep - can do - I’ll work on that this week. It’s been my desire to add some meat to the general concept of copilots, but these things take time, especially for 70+ year old dudes with modest technology successes.

1 Like

In that case, don’t worry about it @bill.french

Your wife’s health is much more important than “hello world copilot”.

Thanks for a honest answer and such candor and please forgive me for putting you on the spot about “walking the talk”.

It’s not really necessary for you to code when you are busy and have other things which are more important.

It’s not that hard to code something like this untested ChatGPT rambling, to be honest:

def get_code_completions(code_snippet):
    prompt = f"Complete the following code:\n\n{code_snippet}\n\nCompletion:"
    response = openai.Completion.create(
        engine="davinci-codex",
        prompt=prompt,
        max_tokens=50,
        n=1,
        stop=None,
        temperature=0.5,
    )
    completions = [choice.text.strip() for choice in response.choices]
    return completions
Code above is just untested ChatGPT blah blah.... FYI

Again, my apologies for holding your feet to the fire on walking the talk. Please keep up your passion and if you are not really deep into coding these days, it’s perfectly OK.

If it makes you feel any better, you are not the only person in our developer community I have been pressing on this topic of “walking the talk” and sharing more code and snippets and less talk and less cheerleading.

I’m simply working to improve the signal-to-noise ratio here and get the focus back to “an OpenAI developers community” (coding, testing, debugging, refactoring) … sometimes I am pushing this harder than other times.

Again, my apologies on calling you out about “walking the talk” by sharing your code here in our developers community.

Thanks

:slight_smile:

2 Likes