Gpt-4-1106-preview is not generating utf-8

API
1

I’m getting a lot of generation from gpt-4-1106-preview not encoded in utf-8. Example (in Portuguese):

“tapetes de entrada com padrões geométricos”

That it correspond to:

b’tapetes de entrada com padr\xc3\x83\xc2\xb5es geom\xc3\x83\xc2\xa9tricos’

Is anyone also experience these outputs?

2

I’ve noticed the same, also occurs with function calling and producing JSON.

3

This is a known bug, we have implemented a fix but it hasn’t rolled out yet. It will be fixed shortly, but until then you will need to identify and handle this encoding issue yourself unfortunately.