You’ll need advance good scrapping techniques to filter the data. Like Fetch only content that is inside paragraph tags. If the information is still too large, create a file out of the scrapped data, upload it to OpenAI vector store and run OpenAI assistant on it.
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Help building a chatbot that learns from a URL and references it in conversation | 1 | 328 | November 5, 2024 | |
| Has OpenAI provided any API resource for web browsing (from specific url), like the GPT4-pro web service? | 4 | 1450 | August 20, 2024 | |
| ChatGPT-4 with website but without webscraping | 3 | 766 | February 6, 2024 | |
| Integrating OpenAI API for Comprehensive Knowledge of My Web App | 2 | 199 | January 23, 2025 | |
| We require current data for crafting questions and evaluating answers accurately. Additionally, we need the capability to access the internet to obtain this up-to-date information | 3 | 1151 | September 26, 2023 |