To clarify, I didn’t change the code to use gpt4, it remains in 3.5 turbo.
Why the error writes GPT4 i’m not sure. Gm
1 Like
Basic port of promptrix AND alphawave, including some example Agents, now on pypi.
thanks to @stevenic (original promptrix and alphawave developer in typescript) for all his support and encouragement.
probably a couple of bugs still in the port, don’t blame him, DM me.
1 Like
Great job!
Updated to the new version but seems I’ll test it in the morning
1 Like
@stevenic This is amazing! Thank you so much for sharing.
I was wondering how the agent handles token limits? I’ve used “smol-ai/developer)” which is based on BabyAGI, but the OpenAI token limits the complexity of the output, simply by the 8k token limit. I’ve used Prompt.md which definitely help, but even still, I can’t get the length of response needed to get the answers I want. Thoughts?
1 Like
I’m only using gpt-3.5-turbo currently so I don’t even have an 8k token limit and I’m having success but it probably depends on the task. I have access to gpt-4 but all of our customers (Microsofts Customers) want to use turbo to save cost so my current focus is making turbo work as well as I possibly can.
What’s your specific scenario?
1 Like
It’s live. pypi alphawave
that should install both alphawave and promptrix, including version 0.2.2 of alphawave Agents. Make sure you get 0.2.2
Runs the macbeth test script! ( from github: alphawave-py/tests/macbeth)
@stevenic is planning an overhaul of agents, so that part might change in subsequent releases.
There aren’t a lot of examples of how to write prompts or validation schema yet, DM me(python) or @stevenic (js) or just discuss here.
I will be posting examples on promptrix-py and alphawave-py tonight.
2 Likes
Were you ever able to resolve this?
New version live that runs complete macbeth test, a pretty thorough exercise of all functionality.
I have a number of examples and if you have Copilot installed it will pretty much write for you, a JSON Schema to validate the JSON response you get back.
basic schema validation built in now!
2 Likes
Now OpenAI can do schema validation internally!
gpt-3.5-turbo-613 and gpt-4-613
but, that is only a small part of the capability of alphawave.
This actually compliments AlphaWave quite nicely. I’ll add support for functions over the weekend. You’ll just pass AlphaWave a FunctionValidator with the schema for the function call you expect.
I can actually make them work for older models like Davinci as well…
1 Like
this makes alphawave all the more important for OS, to keep it competitive. I’ll make sure when I port your update the OSClient still does the right thing.
1 Like
btw, how are we going to support functions? incredibly cool. plugins for the API at last!
Looks like, from their example, that they want to use it for planning (otherwise you don’t need the descriptions. The thing is they’re missing any sort of chain-of-thought fields so I’m not sure how good it’s going to be at planning across multiple turns.
I suspect Alpha Waves Agents will outperform it at planning tasks. I’ll also be curious to see if it still triggers repairs. I know they’ve tuned the model for this task but I bet it still hallucinates at times so I bet you’ll still benefit from having AlphaWave do a secondary validation pass. I have bunch of hallucination test cases I can throw at it but definitely a step in the right direction for them.
yup, on reflection, I agree. I often get overexcited by announcements until I have a chance to think a bit.