When I first call the API with a long question that has context and then enter a second question, it retains that context. What are the limits of this? Does it still remember context after I ask enough questions to exceed the 4k token length? What if I enter context in the first question that is 3k in length and follow up with another question that has context 3k in length. Can it handle both?
1 Like