Bad results for Web Search in Response API

Hi everyone, I tried the new web_search tool in the Response API (using the gpt_web_search_preview model), but its results are very poor. I requested the latest news in America, but they were about four months ago. Then I tried the latest sports news, and those were even worse—around four years ago.

Have you experienced the same issues?

1 Like

Welcome back!

How specific are you with your request?

It’s like the early days of search engines. People input “buy cars” and wonder why it doesn’t return only classic Mustangs! :wink:

Seriously, though, I’d work on a better prompt that has a few more details on what you’re wanting.

1 Like

Hm! Web search seems to be showing the latest on a college basketball tournament that’s happening as we speak. How do you have it configured? Here’s a playground starter prompt you can try with web search enabled in tools: https://platform.openai.com/playground/p/T4U6rwVjng3kKl4UjaPr2CCZ?mode=chat

1 Like

When i tried to ask for instant stock price. It’s ALWAYS wrong. Have you noticed that problem? Thank you.

1 Like

I believe I’ve found the problem.
I tried executing a simple query, specifying in the location object the country US and the city San Diego, with this simple input:

“Give me the latest sports news in the US.”

The list of responses was accurate, and the links associated with them were perfectly consistent with the summaries shown in the response message.

Instead, by setting the location Italy (IT) in the payload (it’s my country) and requesting the input:

“Give me the latest sports news in Italy.”

The result was poor. The response contained very old news (several months old) and the links provided for each suggestion were not coherent, as they all referred to the homepage of a sports site in Italy (without any specific reference to the news summarized in the response message).

At this point, I believe that “location” is a reliability factor and that the model performs better in the US than in other countries.

I invite you to conduct similar tests and share your opinion.

Thank you.

3 Likes

This topic was automatically closed 5 days after the last reply. New replies are no longer allowed.