Just let us manually lower the context length. I was ok with 8k. Id be happy with 16 to 32k and it probably wouldnt time out for so god damn long on big chats. In any case come on, do something!
Just let us manually lower the context length. I was ok with 8k. Id be happy with 16 to 32k and it probably wouldnt time out for so god damn long on big chats. In any case come on, do something!