Differences in API and ChatGPT end user app

There’s no way I’m including all that in the system prompt though! :sweat_smile:

2 Likes

Do you think there is a case for good Ui design here though? As in:

Is the time from when the weather could be purly software extracted and the time the AI makes use of it short enough (5 mins? or less) that it would be better to include it in the prompt as purly context, rather than creating an input that is open ended enough to need a function call…

I see a lot of … lazy is the wrong word.. but poorly thought out and “lessons we’ve learned 20 years ago” design aspects being thrown in the bin in the wake of AI as a processing layer.

I can see the day when agentic systems basically have no traditional software layer, just a set of agents interacting, but then I keep thinking.. a smart afgebnt would create deterministic code to make it’s life easier.. any inteligent entity would create code to simply tasks that compuers are good at.. and AI’s are bad at the same htings we are… :smiley:

1 Like

I think it all depends on the level of detail.

And yes, this is a matter for design and should not just be based on dogma.

It is clear to me that smaller models struggle with similar functions so in general it is good to keep them to a minimum for a cheap fast efficient implementation.

1 Like