Advantages of using default end token? (<|endoftext|>)

Yes, but I’m finding that the instruct series doesn’t really comprehend more complex tasks or anything that requires remembering more than a few sentences. That seems strange since GPT-3 can write such long output. But when I give instructions at the top and then too much information after, the performance falls apart. So I’m breaking things down to be simpler but also to be portable to be used with any large language model. I want to keep my research generalized rather than highly dependent on OpenAI. Furthermore, the INSTRUCT series is in beta so I don’t want my research to break if something changes behind the scenes.

I can give you an example privately if you want.