It looks like GPT-4-32k is rolling out

I ran the timer, and got 38 seconds for an estimated 860 tokens in the response. (Input was minor in tokens, and I assume most processing is in the response).

So, extrapolating this to 8k, I get approximately 6 minutes to respond!

Granted, this is extrapolating off of one point, but, yeah, it’s in the ballpark of your 10 minute estimate!

Good things come to those who wait, I suppose :sleeping:

3 Likes