GPT-4 randomly garbling function call names

Temperature injects noise into the token selection process, whether the softmax is making tokens for a function or a completion. That will give you the chance of the less than ideal selection.

That’s fine if it gives you “kitty” instead of “kitten”, but not when it gives you a different name for your function.

It also might have been tuned on calling functions – but not 1000 examples of your variable names.

1 Like