Has anyone used Advanced generation techniques to generate completions?

API
1

I am trying to improve the quality of output generation by adding more relevant examples chosen by customers, but I don’t see any difference in the output. I am following the below guideline by OpenAI to generate quality generations. I show customers a few outputs and ask them to select the best one they like. I repeat this step 5-6 times and add those outputs in prompts. I was expecting to get more relevant and quality outputs at the end but it still going random and out of context.

Advanced generation techniques You can improve the quality of the responses by making a longer more diverse list in your prompt. One way to do that is to start off with one example, let the API generate more and select the ones that you like best and add them to the list. A few more high-quality variations can dramatically improve the quality of the responses.

1 Like
2

Hello @Not_Wrogn,

Are you able to share your starting prompt and possibly a few iterations of the prompt after you’ve picked out the desired completions? It’ll help us get a better look into what exactly is going on so we can provide better insight into how to improve the generations you’re getting.

You’re not by any chance using any of the Instruct-series models, are you? I tend to get shorter, more concise answers from that specific series, but I will be working with this specific model a lot closer than previously for a few projects of my own, so I don’t have much experience with providing good prompts with the Instruct-series models yet.

Thanks,
Nick

1 Like
3

We will need to see your prompts and settings

4

I start with empty list and davinci-instruct-beta and after the first run, I switch to davinci engine and strat building list of examples.
For example :

For the first run
1)
davinci-instruct-beta
temperature = 0.85,
top_p = 1,
n =4,
frequency_penalty = 1.92,
presence_penalty = 1,

Prompt
Write a creative ad for the following product:

Product: Holo Company
Description: AI content generation for small businesses

a)
It’s not always easy to grow your business in the digital age. Though you have a great product, it can be hard to get noticed without being able to afford big marketing campaigns or influencers. With Holo Company AI content generation software, this is all about to change - put down that phone and try something new!

b)
Isn’t it crazy that you never have the time to do all of your content marketing activities? So even though your company’s social media posts are active and engaging, sometimes there just isn’t enough time in the day to take care of creating quality blog posts, videos or podcasts.
Luckily for you - we created Holo Company! An AI-driven assistant which will be ready at any given moment with high-quality articles on topics relevant for small business owners. Best part is they can

c)
Imagine a world where going viral on Facebook is easy, addictive and affordable. Well it’s here! Introducing Holo Company. Your business can create AI content without any prior experience or marketing skills needed to feed the specific needs of your customer base at just $1 per post for up to 1 million engagements on their feeds each month. It’s like hiring an entire social media team with one click and creating tailored campaigns in seconds: no more generic articles about how good your food tastes!

d)
The future is now, and guess what? It’s full of content for your website. No need to spend hours drafting blogs or updates when the experts at Holo Compay will do it all for you. You can’t afford not to have this amazing artificial intelligence generating ads, tweets and press releases so stop wasting time writing–start saving with a cost-effective AI assistant from Holo Company!

User select output (a) above
2)
Now using davinci
temperature = 0.85,
top_p = 1,
n=4,
frequency_penalty = 1.92,
presence_penalty = 1,

Prompt becomes
Write a creative ad for the following product:

Product: Holo Company
Description: AI content generation for small businesses

It’s not always easy to grow your business in the digital age. Though you have a great product, it can be hard to get noticed without being able to afford big marketing campaigns or influencers. With Holo Company AI content generation software, this is all about to change - put down that phone and try something new!

Product: Holo Company
Description: AI content generation for small businesses

a)
It’s not always easy to grow your business in the digital age. Though you have a great product, it can be hard to get noticed without being able to afford big marketing campaigns or influencers. With Holo Company AI content generation software, this is all about to change - put down that phone and try something new!

b)
(repeating) It’s not always easy to grow your business in the digital age. Though you have a great product, it can be hard to get noticed without being able to afford big marketing campaigns or influencers. With Holo Company AI content generation software, this is all about to change

c)
Holo Company AI content generation software creates and posts fresh and relevant content to your social media daily without the help of humans. It’s a great way to grow an audience - people want things that are new, original, not spammed by bots! Our team has made it easy for you as well with our auto-updater app. Your company can finally be successful online through social media marketing at absolutely no cost or work on your part whatsoever!

d)
Come visit The Holo Company at Facebook HQ! We’ve got software that can help your business grow - click the link above to learn more about our AI content generation capabilities. You’ll be able to increase engagement, boost conversion rates, all while saving money on big marketing campaigns. It doesn’t get any easier than this! Everyone is raving about it… come find out for yourself."

User select output c) above
3)
So now the prompt becomes
Write a creative ad for the following product:

Product: Holo Company
Description: AI content generation for small businesses

It’s not always easy to grow your business in the digital age. Though you have a great product, it can be hard to get noticed without being able to afford big marketing campaigns or influencers. With Holo Company AI content generation software, this is all about to change - put down that phone and try something new!

Product: Holo Company
Description: AI content generation for small businesses

Holo Company AI content generation software creates and posts fresh and relevant content to your social media daily without the help of humans. It’s a great way to grow an audience - people want things that are new, original, not spammed by bots! Our team has made it easy for you as well with our auto-updater app. Your company can finally be successful online through social media marketing at absolutely no cost or work on your part whatsoever!

Product: Holo Company
Description: AI content generation for small businesses

a) Are you tired of hiring interns who don’t know what they’re doing and paying them to do the job that your company desperately needs done? We can help! With Holo Company AI content generation software, we will automate all social media posting works in a matter of days…all without costing you anything extra. The best part is - there’s no human required unlike other companies around here.

b) If you want to be successful, then it’s time to go with a tried and true method. Stop paying for things that don’t work online! Get those ads up on Twitter, Facebook, Instagram - make them as personal as possible by having your software take care of the rest. The future is here now - stop working so hard trying to do everything yourself already…

c) It’s no longer easy to grow your business in the digital age. Though you have a great product, it can be hard to get noticed without being able to afford big marketing campaigns or influencers. With Holo Company AI content generation software, this is all about to change - put down that phone and try something new!

d) If you want to be successful, then it’s time to go with a tried and true method. Stop paying for things that don’t work online! Get those ads up on Twitter, Facebook, Instagram - make them as personal as possible by having your software take care of the rest. The future is here now - stop working so hard trying to do everything yourself already…

User select output d) above
4)
So now the prompt becomes
Write a creative ad for the following product:

Product: Holo Company
Description: AI content generation for small businesses

It’s not always easy to grow your business in the digital age. Though you have a great product, it can be hard to get noticed without being able to afford big marketing campaigns or influencers. With Holo Company AI content generation software, this is all about to change - put down that phone and try something new!

Product: Holo Company
Description: AI content generation for small businesses

Holo Company AI content generation software creates and posts fresh and relevant content to your social media daily without the help of humans. It’s a great way to grow an audience - people want things that are new, original, not spammed by bots! Our team has made it easy for you as well with our auto-updater app. Your company can finally be successful online through social media marketing at absolutely no cost or work on your part whatsoever!

Product: Holo Company
Description: AI content generation for small businesses

If you want to be successful, then it’s time to go with a tried and true method. Stop paying for things that don’t work online! Get those ads up on Twitter, Facebook, Instagram - make them as personal as possible by having your software take care of the rest. The future is here now - stop working so hard trying to do everything yourself already…

Product: Holo Company
Description: AI content generation for small businesses

Now I would have expected a quality output here after adding 4 quality examples in the prompt. But this is what I get below.

a) We’re more than just a company, we make your business shine with holographic content.

b) “Introducing the coolest AI for your company!”

c) The first thing you do after getting your new logo idea is put it to the test. Uploading a photo of yourself on Facebook with the proposed design, reaching out for feedback that will either confirm or deny what you already knew—you may have some work ahead. Introducing Holo Company AI content generation technology powered by artificial intelligence and machine learning algorithms to help small businesses get professional grade visual representation without hiring someone else, providing everything from logos to banner ads within minutes allowing them more time in their

d) Forget hiring a marketing team and putting together an agency to reach your followers. The future of business is on the brink, and it’s right here with us now. Stop trying to play catch up, Holo Company brings AI-generated content straight from our servers for small businesses like yours - all day every day! With even more fun new features such as photo manipulation, basic web design templates or animated gifs starting at just $10/month, we’re the only one you’ll ever

Not sure, where the problem is.

Thanks for your help :slight_smile:

1 Like
5

I would give it more structure. For the best results I combine zero shot with few shot methods. That means you start with very detailed instructions with adjectives. Then you give it a few labeled examples. Then you let it continue generating examples. It also might be getting confused by your use of letters. I would just use dashes for lists.

7

Yeah, that is right. There are no letters in the real completions.

8

Hello @Not_Wrogn,

I modified the starting prompt, but used the last iteration of your completion inside of Playground and I think that it’s generating content that’s more of your liking. I believe what was going on was that you simply ask for a creative ad from Davinci, however when it generates ads you are expecting it to be of a certain length so I specified that you want ‘fairly long’ ads and it seems to be generating longer content. I have not yet had a short completion from Davinci:

image
image1622×569 45.6 KB

Another completion I performed through the Python console instead of Playground:

If you want to stand out online, then it’s time for something no one is doing - get posts from your company on social media but without any human interaction! The cloud-based automated software will do the work so that no matter what day of the week or time at night, there are fresh and relevant things going up to keep your audience engaged while freeing up more of your own personal energy and creativity to create better content yourself…

Starting prompt I used:

Write a fairly long creative ad for the following product:

Let me know if this helps, if you still find that you’re not getting quite the desired results, then I’ve found that being more detailed in your prompt does help drastically!

9

Hi @DutytoDevelop, Wow, It worked! I made a little change in the prompt as you suggested and it is working fine now, so far.

However, I expect the actual words in the prompts shouldn’t have much impact on the outcome unless using DaVinci-instruct. In the case of Davinci, as they said, “show rather than tell”, helps it to understand better what do we want. I have been feeding fairly long examples. Looks like the prompt text itself still matters :slight_smile:

Thanks.

3 Likes
10

My path isn’t particularly advanced, but it works! In essence it is to find sentences that refer clearly to the notion you’re after. I came to OpenAI looking to generate ideas from keyword hyper-graphs derived from texts. Focus was obtained by selecting sentences according to keywords connected in the hypergraph ~ if the words happen together in sentences then those sentences could be used as prompts ( as they exemplify the notion ). Here’s a snapshot of a hypergraph on Aristotle from the SEP.

image
image1021×572 53 KB
, and here’s what come out,
image
image1112×716 71.9 KB
. I’m rolling out a smart library on GPT-3 soon, so stay tooned.