Summary created by AI.
The GPT-4-32K model has begun to roll out and is reportedly available in the Playground. The model can accept a payload, such as a postmodern fiction piece, and generate meaningful outcomes with increased context length. Curt.kennedy claimed to have seen the model pop up in the Playground and shared a screenshot of his account to substantiate his claim. Other users reported being unable to access the model but revealed that the 8K model was available to them. Several users speculated that the roll-out might be proceeding based on the order in which people joined the waitlist.
The extended context window of the new model could be useful for applications such as Q/A Chatbots, large data summarization, and understanding. The extended context could also potentially allow for more advanced reasoning in factual-rich domains. However, some members noted that the response time could be slow, and the cost is higher with the Input priced at $0.06 / 1K tokens and output at $0.12 / 1K tokens.
There were also discussions around the actual context window of the model, with some claiming that it doesn’t seem like an actual 8K context. Some users noted the limitations in the chatGPT that make it conversational and prevent the use of all tokens in one go. Other users maintained that the new model surpasses an API containing 8K tokens, with some reporting a significant increase in speed with the GPT-4-32K model.