I’ve been looking at incorporating the edit API into an application, but I’m finding that things that work fine in the edit playground do not work in the edit API, and I’m a bit perplexed as to why this might be, since it appears that the site is hitting the same endpoint.
For example, I submitted the following request to both:
instruction:
Replace all abbreviations, honorifics, titles, political party indicators, and all
other shortenings with their full pronunciation.
temperature: 0.1
top_p: 1
text:
Lustig is an emeritus professor of pediatrics at the University of California at San Francisco and the author of “Metabolical: The Lure and the Lies of Processed Food, Nutrition and Modern Medicine.” Body: Whats the difference between RSV, the flu and covid-19? You dont have to worry about your stomach exploding if you overeat. For some with ADHD, brown noise quiets the brain. Life: The Well+Being gift guide has our picks for the body, mind, pets and more. These five tips from experts can help students take a mental health break from college. What to feed and not feed pets from holiday dishes. Food: Diet changes can improve sleep apnea, even without weight loss. Fiber alters the microbiome and may boost cancer treatment. How to support your sober friends when everyone is drinking. Fitness: Dogs and humans both can get dementia, and more walks can help. Pickleball is popular, but how much exercise are you really getting? This is the speedy scientific workout you can do almost anywhere. Mind: Tips for parents to help teens struggling with mental health issues. Want to feel happier? Try snacking on joy. Three ways to fix sleep issues when nothing else works. Five reasons to report your fantasy football and gig income to the IRS
In the playground it works as expected, but when making the request against the API I get a 400 error with the error response
"error": {
"message": "Could not edit text. Please sample again or try with a different temperature setting, input, or instruction.",
"type": "invalid_edit",
"param": null,
"code": null
}
I’ve gotten this error for many API requests, but never in the playground. There appears to be a correlation with the length of the text in the request, as reducing the text reduces the incidence of these errors (but doesn’t eliminate them totally). Is there some hidden text limit or processing time limit that I’m hitting? Is it possible to make this configurable?
Furthermore, chopping up the text in my requests makes my application very slow, since each API request takes quite a while to serve, so I’d very much like to send as much text as possible in each request.