Why get different facts in two language with same meaning?

API
1

Here is the simple python code to call my chatgpt:

from openai import OpenAI

client = OpenAI(
    api_key = 'xxxxxx',
)

def chat_gpt(prompt):
    response = client.chat.completions.create(
        model="gpt-3.5-turbo-0613",
        messages=[{"role": "user", "content": prompt}]
    )
    return response.choices[0].message.content.strip()

There are the same meaning in English and Chinese:
世界上最大的机场 == the largest airport in the world

Why get total different facts in two language with same meaning?

>>> chat_gpt('世界上最大的机场')
'世界上最大的机场是位于中国北京的北京大兴国际机场，其总占地面积达到47万平方米，跨度宽度1.4公里，是一座新建的现代化综合性机场。机场拥有七条跑道和四个航站楼，并且还具备了大规模机库和停机坪。这座机场于2019年9月正式投入使用。'
(It says that the largest airport is the Beijing airport in China.)
>>> chat_gpt('the largest airport in the world')
'The King Fahd International Airport in Dammam, Saudi Arabia, is considered the largest airport in the world by area, covering 780 square kilometers (301 square miles).'
1 Like
2

My guess would be bias from the training data. “Largest airport” leaves a lot of room for interpretation (e.g. surface area covered? Most terminals? Highest passenger traffic?) and this is probable ambiguous enough that language-specific training data sways the output.

I just tested with GPT-4 and received the same language-dependant response.

3

Indeed, another unneeded refusal has to be overcome, but a much longer typing session with ChatGPT, we can see that the question has many answers.

Metric Ranked 1 Ranked 2 Ranked 3
Total Passenger Traffic Hartsfield-Jackson ATL Beijing Capital PEK Dubai International
Surface Area King Fahd International Denver International Dallas/Fort Worth
Number of Runways Hartsfield-Jackson ATL Denver International Beijing Capital PEK
Number of Terminals King Fahd International Dubai International Hartsfield-Jackson ATL
Aircraft Movements Hartsfield-Jackson ATL Beijing Capital PEK Dubai International
Cargo Volume Hong Kong International Memphis International Shanghai Pudong
International Connectivity Dubai International London Heathrow Hong Kong International
Longest Runway Qamdo Bamda Airport Beijing Daxing King Fahd International
Number of Gates Hartsfield-Jackson ATL Beijing Capital PEK Dubai International
Number of Destinations Served Hartsfield-Jackson ATL Frankfurt Airport Amsterdam Schiphol

“Please note, this is just generative language from gpt-3.5-turbo, and may reflect nothing”

1 Like