How can I scrape websites and extract data to create structured entities?

Prompting
1

Hi everyone,

I’m new to this API and I’m trying to scrape websites to extract unstructured data with the goal of creating fixed entities using a known interface. However, I’m having trouble getting the results I want. Has anyone else done this before? Do you have any suggestions or tips for how to accomplish this task? And do you think this API is a good choice for this purpose?

Thanks in advance

2

Definitely look at Browse.ai https://browse.ai

I struggled with a couple of scrapers for several days, and didn’t even try Apify because of the javascript requirements. Browse.ai uses AI to set up scraper and, relatively speaking, couldn’t be easier to use. It also has integrations including Google Sheets and Zapier.

1 Like
3

You can useperplexity.ai which has website browsing feature with GPT4.
Alternatively, you can use scrape.do for scraping without hassle.