I built a barebones NPM package that automatically manages request and token throttling for Open AI requests. Currently hardcoded to GPT-3 but will soon give the user full control over which model to use when making the request to OpenAI.
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
OpenAI API wrapper for nodeJS | 1 | 1108 | December 27, 2023 | |
OpenAI API in NodeJS & TypeScript | 1 | 8774 | December 27, 2023 | |
Best Practices for Handling Rate Limits in OpenAI API Integration | 0 | 1564 | February 26, 2024 | |
Hitting Rate Limit with small group of Users? | 14 | 6085 | January 20, 2024 | |
Rate limiting strategies? | 4 | 5079 | January 8, 2022 |