ChatGPT 4.0 keeps hallucinating exact quotes from the free-response data I've loaded

GPT4 can only handle up to ~ 8000 tokens, so feeding it 50k rows of data can’t work. It will just remember the last ~ 8000 tokens from those. And if that wasn’t bad enough there is more problems currently: