today I was brewing my first gpt-4 api based app in PHP and I am SHOCKED with discrepancies between responses from API and Playground.
Before I have started sending prompts/commands/content via api, I have prepared system and user prompts, verified temperature and top_p parameters and I was extremely happy with the results. The task was to rewrite article keeping core points, print it out in requested format “[Title:$title|Article:$content]”, use Markdown to mark every header (form h1 to h3). Results in Playground were PERFECT.
Thrilled, I have COPIED my Playground setup to API and… results are just AWFUL. Nothing is like in the Playground. Style is bad. Quality is poor. He is even quoting some of the system setup sentences! Of course format is nothing like expected - it is just a flow of words without general idea where does the tile ends and article starts. Headers are missing, so of course they are not Markdown-formatted as well… Just terrible experience.
So my questions is - am I doing something wrong? Am I missing some part of the setup, or maybe my expectations are too high? (but both Chat and Playground did wonderful job…)