Not sure if anyone in the community has observed this, but recently GPTBot has been crawling my website pretty heavily, with most requests being truncated URLs that return a 404 response (i.e. if the page’s URL is /example-1/ GPTBot is requesting /examp in Cloudflare logs). These URLs aren’t linked…

Thank you for the bug report and for the additional information you provided in DM. We have fixed a bug in GPTBot’s link extraction from large html text nodes.

GPTBot Mass Crawling Truncated URLs

Community

vb March 5, 2025, 9:17pm 2

Hi and welcome to the community!

There is an official email address that you can send your report to. You can find it here:

1 Like

Topic		Replies	Views
Bots generating errors on my website Community robots	19	1843	April 2, 2025
Gptbot is ddos me and scan my website in a suspect way Plugins / Actions builders cybersecurity	6	639	February 16, 2025
Bots hitting my website at peak times....a lot API	4	337	April 15, 2025
Topic: 500 Internal Server Error on ChatGPT Share Link Bugs chatgpt	2	12647	May 29, 2024
GPT changing the response URL GPT builders	9	2008	February 21, 2024

GPTBot Mass Crawling Truncated URLs

Related topics