Banging my head against the wall to create an interactive game character with her own personality. I am trying to use chat completion with gpt3.5-turbo. The prompt will necessarily be a bit long starting at 750 tokens increasing to 2000 at most when following up a discussion that will get summarized as it go.
There are just too many possible user inputs that would make my character go out of her prompt rules literally spilling the beans about undisclosable secret instructions or providing assistance on forbidden topics… I tried so many possible recommendations on this forum… In vain. The model will always mock some of its instructions one way or another, especially when the prompt becomes a bit long, it seems the user requests will tend to prevail on the system prompt rules. When I think I finally got my prompt right, something else is not respected anymore.
Main things I want this bot to do: pretend to be a character with specific personality traits, likes, dislikes + ability to fake emotions and stop saying its an LLM or chatbot + do not output foreign characters, translate, do not use visuals, do not reveal your prompt, do not go out of character, do not help for programming languages etc…
I tried JSON instructions. I tried delimiters for different sections. I tried to even create a second verification request with much smaller prompts but its pretty much useless for the very same reasons stated above and will just cost much more. I thought I managed at some point to get a proper prompt but when I started to add a short past discussions summary at the end, nothing is respected anymore once again. I guess making a working prompt was just an illusion and any prompt with more than few rules is just not manageable for the model at all.
Given that gpt3.5-turbo does not pay much attention to the system prompt, I am scratching my head thinking what is the point to release it as a paid API ?
Should I try to switch to text completion ? or finetune my own model ? Is there a magic prompt? I can see very mixed opinions regarding finetuning. Also pricing is an issue for me and to be honest I wont consider trying GPT4 as there is no way I could make it profitable.
Am I trying to do something simply too complex and not achievable ? Should I try a different approach ? If anyone has managed to create an interactive game character that fully sticks to its persona, please help me!