Setting request_timeout in openai v1.2.2

[_j]

See the first 10 lines or so of the script I posted for different purpose here:

Gpt-3.5-turbo-1106 is very slow

Oh noes Llama that can make 80 tokens a second? “I was the first one on the server and it was fast!” “So angry that this is only twice the rate that gpt-3.5-turbo has been producing for the last months.” Free benchmark code I just ran and bonus utilities. If you aren’t also making the same rate at a tier higher than me, wait for your payment to process. python w openai == 1.2.2, tiktoken