# Model: Web Browsing almost always says "click failed"

**URL:** <https://community.openai.com/t/model-web-browsing-almost-always-says-click-failed/216711>\
**Category:** Plugins / Actions builders\
**Tags:** gpt-4, web-browsing\
**Created:** [May 18, 2023, 12:45pm UTC](https://community.openai.com/t/model-web-browsing-almost-always-says-click-failed/216711 "2023-05-18T12:45:26Z")\
**Posts on this page:** 1\
**Showing post:** 7

<div class="post-metadata">

**Author:** ![anon10827405](https://avatars.discourse-cdn.com/v4/letter/a/ed8c4c/32.png) [@anon10827405](https://community.openai.com/u/anon10827405)\
**Post date:** [May 18, 2023, 2:59pm UTC](https://community.openai.com/t/model-web-browsing-almost-always-says-click-failed/216711/7 "2023-05-18T14:59:55Z")

</div>

> [@anon22939549](#):
>
> I think we’ll see both web browsing plugins emerge which ignore robots.txt and sites like archive.is sprout up specifically for LLMs to interact with which will greatly improve the experience for users.

I honestly think the opposite. I think robots.txt will soon be enforceable by law and websites like the wayback machine will [be beaten into submission](https://time.com/6266147/internet-archive-copyright-infringement-books-lawsuit/). Who would want other, usually paid-for services, to leech off their content? Instead I think they’ll open paid-for API endpoints to gather and have a legal right to the data. Unless you’re the product, you will need to pay.

I mean, look at Facebook’s code. ReactJS already does a pretty good job of preventing simple scraping, but they also use many honeypots, obfuscations, hidden tricks, and even an AI to catch bots.

---

_[View the full topic](https://community.openai.com/t/model-web-browsing-almost-always-says-click-failed/216711)._