I am working on a project for my company. My testers are complaining that what I provide them is not a good alternative to end use app (ChatGPT)
I am using model chatgpt4o
Missing/different items:
API does not answer correctly to the questions like “what date is it”. It does not know the actual date. How can I adjust that other than giving an “instruction” parameter like “today is …”. What is the official method ?
API does not answer correctly to the questions like “how is the weather”. Of course it doesn’t know the location of the user. Would it provide correct answer if I provide an instruction parameter with user’s location ? Is there a suggested method for this ?
I am using speech to text endpoint for microphone input. There are some words or sentences similar in sound in different languages. For example “merhaba” is same in Turkish and Arabic. When the user is talking Turkish most of the time endpoint understands in Turkish, but in between sometimes endpoint understands it as if Arabic. I don’t want to enforce the language input from user’s locale. Because then when the user wants to use another language, it will not be interpreted correctly. Will it ? What is the best approach here ?
On API , we have 6 voices to use for text to speech. But on the app there are 5 voices and some of them are really better than API voices. Will they be added to the API later ?
If using “Assistants”, you don’t have 100% control over the input that is sent every time.
There is an “additional_instructions” parameter that you can include, that would be the logical place remaining to place a computer-generated date, and then improve that with the locale so it switches for the user.
AI is not a personal assistant that will answer question such as “play the latest Taylor Swift song”. It can call on programmed tools you provide by function-calling if you need a weather bot, though, using some separate service that provides that information. All its knowledge is pretrained in a long process, and fixed unless you input more text when you call the AI.
As programmer, you can give a user interface with multiple remembered settings, such as the language the user wants to speak and have recognized. Then it can be passed by ISO code to whisper.
The voice actors seem to have signed particular agreements for how their voice would be used, and OpenAI wants to keep their ChatGPT separate from the products of another. So the voices seem like they would remain separate, as their is no technical reason for the current separation.
@_J thanks for your comment.
Actuallly, the problem is not what I can do or can not do on the user interface.
I opened this thread to discuss the differences between API and the ChatGPT app.
For example, I don’t understand the reason why API does not know the current date while ChatGPT knows.
Of course we can use instruction parameter , it is very simple. But I asked it here because I might be missing something. Maybe a misconfiguration I do while creating the assistant and/or thread.
And API really has too few female voice options compared to the app. That’s not fair…
I could not understand what you meant here. Is the Plus version acting similar to what API provides ?
ps. English is not my native language. So maybe you wrote something meaningful but I did not understand
If your AI doesn’t have to ask where the user is, but location is part of their customer account, it still may be profitable to throw that blip of info into a message automatically, rather than a tool loop doubling the context cost when they ask.
I think this could fall under one of the classic tenants of UI design: If it can be pre-calculated, fill it in for the user.
Same thing really, if you know anything ahead of time, fill that in as part of the prompt, don’t use function calling for the sake of it. Anything you can do deterministically and simply, including as context is better than asking for a function call to be made.
I see where you’re heading with that, and I agree, if you don’t “NEED” a specific peice of context in a prompt, don’t include it. Pet hate of mine is seeing irrelivent junk in prompts, but if it is needed then determistically prefilling it is better than letting the AI decide to make a function call, if it can at all be avoided.
Sure, for some things, it can’t be avoided, but there is a lot of function calling being done that could be fairly simply avoided with careful prompt flow. I lament the now common UI element of an empty text box for user input, humans have never been very good eith openended inputs
Weather Forecast for San Francisco, San Francisco County County, California:
Current Weather at 2025-05-26 05:30 UTC:
Temperature every 6 hours:
Precipitation Probability every 6 hours: