It seems that you might be encountering rate-limiting issues (status code 429) and occasional server errors (status code 502). Here’s what you can do to handle these issues:
Rate Limiting: Add a small delay between API calls, like using setTimeout or another method to add a pause. This will help you stay within the rate limits imposed by the API.
Error Handling: It’s important to handle any errors returned by the API gracefully. You could implement retry logic with exponential backoff for status codes like 429 and 502, giving the API some time before trying again
Here’s a modified version of your existing code snippet with added error handling and rate limiting:
const sleep = (ms) => new Promise((resolve) => setTimeout(resolve, ms));
const processSection = async (elem) => {
if (model === "text-davinci-003") {
const requestData = {
temp: parseFloat(temp),
model: model,
frequency_penalty: parseFloat(freqPenalty),
presence_penalty: parseFloat(presencePenalty),
prompt: // ... Your prompt ...
};
let retries = 3;
let response;
while (retries > 0) {
try {
response = await module.exports.initOpenAIConfiguration(requestData);
if (response) {
let responseList = {};
response = response.split('\n').filter(n => n);
responseList[elem.section] = response;
return responseList;
}
} catch (error) {
if (error.statusCode === 429 || error.statusCode === 502) {
await sleep(1000 * Math.pow(2, retries)); // Exponential backoff
retries--;
} else {
throw error;
}
}
}
throw new Error('API call failed after multiple retries');
}
};
(async () => {
const promises = sectionList.map(async (elem) => {
const result = await processSection(elem);
await sleep(200); // Adding a small delay between API calls
return result;
});
const responses = await Promise.all(promises);
console.log(responses);
})();
This code adds error handling and rate limiting to your existing implementation. Be sure to adjust the sleep time for backoff and between API calls as needed.