How to remove weird unicode characters in my response

API
1

Hi,

I am currently using openai library in python with a key for the openaI Platform API. The issue I have is that the response very often contains weird characters that doesn’t display correctly in UTF-8 like Thin Space for example

it is kind of annoying to have to process the response with something like this (example purely for explanation)

final_text = text.replace('\u2009', ' ')
final_text = final_text.replace('\u00A0', ' ')
final_text = final_text.replace('\u202F', ' ')
final_text = final_text.replace("\u2005", ' ')

Can’t we request the API to provide proper encoding consistently ? or will I have to cleaned it up manually everytime ?