It was actually posted on the Foundational must read GPT/LLM papers - #15 by qrdl thread, but I agree it’s a very interesting paper!
I found Karpathy’s shade throwing around this sort of thing very unfortunate.
I mean I could just say:
Overheard: “People who know nothing about pure mathematics are now paradoxically advantaged in machine learning because they don’t immediately reach for overly sophisticated math and spend a lot more time hacking ML algs” When hacking ML algs feels below your dignity but it works :’|
The OAI folks post a lot of … stuff … on twitter. Maybe they could dial it back a bit. We have enough noise going around already.