I too am having this issue. I get better results when using a chat dialog, but through the api my results are hugely inconsistent.
I’ve been trying to solve it all day and not really any further than when I began :-/.
I get a lot of random 500 server errors as well, with no changes to the prompt. Both issues are driving me nuts.