Which api to use in my case?

[thinktank]

@jochenschultz

Think of a LLM like an intern that has a father who got a phd in everything.

I also think we can all agree that they’re called Micro Agents and @stevenic coined the phrase. Hail steve.

@platypus

You may want to either simplify your instruction so it’s <=1000 tokens, or consider doing it in multiple stages (multiple sequential API calls)

Good rule of thumb. Thanks.

@icdev2dev

What I have been advocating for (and the code is open source) is to use both the Assistant API and the Chat Completion API. The rationale, in my mind, is simple.

Use Assistants, Threads and Messages from Assistant API) as a persistent store of instructions and interactions with the LLMs. Use ChatCompletion to do text generation.

That’s a neat idea IC’d. But why not just use Assistants across the board since they’re basically Completions with more abilities?

@sudirlay

and train a custom model from a base where you train it on most of the instructions you are sending so that when you initiate a completions session for the YouTube text, you are not sending all those instructions everytime with the text.

There really is no way to “train your own model” right now. You can fine tune a model, but this is to help “fine tune” things like tone and diction, its not the same thing as training on a data set. @jr.2509 describes it well here, and recommends this article.

Finally, @apris I agree with ICD and Jochen that you should be looking at hyper specialized micro agents to individually work on your flow on single-minded tasks. Think of Henry Ford’s Assembly Line but for tireless AI Assistants.