Crawling Website Tutorial Rate Limit Error

API
1

While working through this tutorial, I encountered the Rate Limit Error. It says you have a Limit of : 60.000000 / min. But your Current is.: 70.000000 / min. Please add a payment method to your account to increase your rate limit.

Do we have to be a non-free tier member to learn from this tutorial?

2

While working through which tutorial?

3

I stand corrected. I meant while running the code given in the tutorial!

4

Can you post the code in question? Which tutorial?

I don’t think they would post code that would hit it too often, but I could be wrong.

Thanks.

5

I am referring to this tutorial (hyperlink): How to build an AI…

The code snippet is the one where we create the embeddings. It’s here:

df['embeddings'] = df.text.apply(
        lambda x: openai.Embedding.create(input=x, engine='text-embedding-ada-002')['data'][0]['embedding'])
1 Like
6

Okay, yeah, thanks.

If it’s not working on free-tier, or you can’t pause, it looks like you’ll need a paid plan.

You could try leaving a thoughtful post in the Feedback topic of this forum if you’d like.

Can you try embedding less text maybe? You know what they say about free!

1 Like
7

Thanks for the reply.

Yeah, free loaders are not welcome :wink:

8

The tutorial clearly stated in the header I would imagine, getting the same error also.

9

hi I’m getting a network error

Traceback (most recent call last):
File “/Users/adigweleo/web-crawl-q-and-a-example/web-qa.py”, line 302, in
df[‘embeddings’] = df.text.apply(lambda x: openai.Embedding.create(input=x, engine=‘text-embedding-ada-002’)[‘data’][0][‘embedding’])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/Users/adigweleo/env/lib/python3.11/site-packages/pandas/core/series.py”, line 4771, in apply
return SeriesApply(self, func, convert_dtype, args, kwargs).apply()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/Users/adigweleo/env/lib/python3.11/site-packages/pandas/core/apply.py”, line 1105, in apply
return self.apply_standard()
^^^^^^^^^^^^^^^^^^^^^
File “/Users/adigweleo/env/lib/python3.11/site-packages/pandas/core/apply.py”, line 1156, in apply_standard
mapped = lib.map_infer(
^^^^^^^^^^^^^^
File “pandas/_libs/lib.pyx”, line 2918, in pandas._libs.lib.map_infer
File “/Users/adigweleo/web-crawl-q-and-a-example/web-qa.py”, line 302, in
df[‘embeddings’] = df.text.apply(lambda x: openai.Embedding.create(input=x, engine=‘text-embedding-ada-002’)[‘data’][0][‘embedding’])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/Users/adigweleo/env/lib/python3.11/site-packages/openai/api_resources/embedding.py”, line 33, in create
response = super().create(args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/Users/adigweleo/env/lib/python3.11/site-packages/openai/api_resources/abstract/engine_api_resource.py”, line 153, in create
response, _, api_key = requestor.request(
^^^^^^^^^^^^^^^^^^
File “/Users/adigweleo/env/lib/python3.11/site-packages/openai/api_requestor.py”, line 230, in request
resp, got_stream = self._interpret_response(result, stream)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/Users/adigweleo/env/lib/python3.11/site-packages/openai/api_requestor.py”, line 624, in _interpret_response
self._interpret_response_line(
File “/Users/adigweleo/env/lib/python3.11/site-packages/openai/api_requestor.py”, line 687, in _interpret_response_line
raise self.handle_error_response(
openai.error.APIError: The server had an error while processing your request. Sorry about that! {
“error”: {
“message”: “The server had an error while processing your request. Sorry about that!”,
“type”: “server_error”,
“param”: null,
“code”: null
}
}
500 {‘error’: {‘message’: ‘The server had an error while processing your request. Sorry about that!’, ‘type’: ‘server_error’, ‘param’: None, ‘code’: None}} {‘Date’: ‘Sun, 04 Feb 2024 11:00:27 GMT’, ‘Content-Type’: ‘application/json’, ‘Content-Length’: ‘176’, ‘Connection’: ‘keep-alive’, ‘access-control-allow-origin’: '', ‘openai-model’: ‘text-embedding-ada-002’, ‘openai-organization’: ‘user-pnwtj3ua6h8k5zft5z1egnmw’, ‘openai-processing-ms’: ‘2106’, ‘openai-version’: ‘2020-10-01’, ‘strict-transport-security’: ‘max-age=15724800; includeSubDomains’, ‘x-ratelimit-limit-requests’: ‘3000’, ‘x-ratelimit-limit-tokens’: ‘1000000’, ‘x-ratelimit-remaining-requests’: ‘2999’, ‘x-ratelimit-remaining-tokens’: ‘999743’, ‘x-ratelimit-reset-requests’: ‘20ms’, ‘x-ratelimit-reset-tokens’: ‘15ms’, ‘x-request-id’: ‘27a1f21f8f7e54ef09edd0d74d123b5a’, ‘CF-Cache-Status’: ‘DYNAMIC’, ‘Server’: ‘cloudflare’, ‘CF-RAY’: ‘850268e7391854b7-MAN’, ‘alt-svc’: ‘h3=“:443”; ma=86400’}
please help me