BTW … here is my favorite test at the moment for “AGI” or “Super Human Intelligence” that anyone can do.
Get GPT4 to answer a query by searching the web.
Man does it suck! I never use it anymore and just do it myself.
It’s a really excellent example of how poorly it reasons with novel info (in a high dimensional action space, to steal Curt’s description.)