I was just testing the code model with a basic prompt of:
“”"
create a python app to:
search the web for a given name
extract the text content from each of the results
look through each of these results for other given keywords and also extract any names
optionally, perform recursive searches on any new names found
“”"
Output started off fine but then quickly devolved to include long strings of curse words, sentences about satan and then started listing off random animal names (warning attached image contains profanity) -
Yeah, I found that the code series models work well for code completions and short, simple methods, but they “fall apart” with more complex requests, like the one above.
I just ran your prompt with text-davinci-003 as follows: