GPT’s Achilles heel is file updates. Once it gets a few updates of a given file with the same name (like an editor.h file) it seems to have no idea how to differentiate between them. I read its thought process and it appears to have some sort of internal numbering system, but its absolutely useless to it. Even, when I upload a file and say “Analyize this specific version of the file Im uploading with this prompt”, it still struggles to the point that nothing it says can be trusted. Its trying to rely on specific lines of code it expects to see, but its so confused half the time that it finds an old obsolete version and references that one anyway… with the overconfidence of a certain orange octogenerian American fascist leader.
It also constantly goes to Python as its go-to for code, despite the fact that Ive only ever used it to assist me in C++.
My original reason to give it a chance was so that I could gauge how close we are to the day its kills our species off and gauge its weaknesses, and the answer seems clear. The key to saving mankind when GPT comes for us is… Just confuse it as easily as you would a small child.