I am using the playground since a couple of days. I want to generate German short descriptions about German cities.
First attempt: “completion mode” with davinci-text-003.
A prompt with all settings set to default, would look like this:
"Schreibe eine Kurzbeschreibung über die Stadt “Hamburg”. (Write a short description about the city “Hamburg”.)
I was surprised that the answers vary a lot in regard to quality. There is an almost 30% chance that I get a result being unusable. It then responds clearly wrong information, such as “Hamburg is the biggest city in Germany”, which is actually Berlin and Hamburg 2nd largest. Given that Hamburg has a pop of 1.8M and Berlin 3.6M, this is a pretty big mistake.
For another smaller city that I know, it mixes up the cities’ amenities with those of a city nearby.
Asking it the same questions in English, I get better results. Hamburg is not the biggest city anymore, but it still tells me a church in “Kempten” is located in “Kaufbeuren”, which is wrong.
Second attempt: “chat-mode” with gpt-3.5-turbo.
None of such mistakes happen. The responses are totally usable and all information is correct.
I am wondering if gpt-3.5-turbo is another improved model compared to davinci-text-003.