tired to embed the csv file values. without tokenizing , I was able to embed them . but after tokenization and chunking ,kept getting the rate error by using “text-embedding-ada-002”.
code
df[‘embeddings’] = df.text.apply(lambda x: client.embeddings.create(input=x, model=‘text-embedding-ada-002’).data[0].embedding)
time.sleep(200)
error :
RateLimitError: Error code: 429 - {‘error’: {‘message’: ‘Rate limit reached for text-embedding-ada-002 in organization org-TqD8sAIY0GgeDNYDRy3JyJdL on requests per min (RPM): Limit 3, Used 3, Requested 1. Please try again in 20s. Visit https://platform.openai.com/account/rate-limits to learn more. You can increase your rate limit by adding a payment method to your account at https://platform.openai.com/account/billing.’, ‘type’: ‘requests’, ‘param’: None, ‘code’: ‘rate_limit_exceeded’}}