First is to find a search API, unless you have a specific site you want crawled and indexed.
There’s a github repo for a duckduckgo python method that doesn’t cost - as long as it still works. Bing APIs, APIs that pirate Google…
So then you have function that can get URLs and search summaries.
Browsing arbitrary web pages is harder. You’re going to get tons of “Javascript required” if you just wget.
Beautiful Soup, Selenium - browse directly with more js
puppeteer (Pyppeteer), Playwright - browser controllers