ChatGPT/OpenAI for Scraping Article Text

Can ChatGPT/OpenAI Playground extract the text of the news articles (Al Jazeera, BBC Sky Sports, etc.) excluding any unrelated content from other parts of the page (the footer, adverts, related article links etc.)?

The AI isn’t hooked up to the web, but you can put whatever text data you want in the prompt and ask it to do something with it, or provide context for it and have it do stuff.

Thanks for the swift response! Would that need to be one URL/article at a time or would I be able to dump a few and let it work its magic?

It’s measured by total tokens in the Input + Output. Currently set to a max of around 4000 tokens (varies by model), or 3000 English words.

1 Like