After working on this for hours today, easily seeing fatal errors for exceeding 4096 way too much. I am going to experiment with stripping out all assistant replies from the API.
This 4096 token limit is VERY restrictive!
1 Like