I am still wondering how they got access to almost a billion dollars worth of H100s.
2 Likes
I’d imagine by spending almost a billion dollars!
The thing that might get quite interesting is that Llama 3.1 405b meets the EU AI Act’s compute threshold of 10^25 FLOPs, with them using 3.8^25 FLOPs training it. This means that it meets the definition of potentially posing a “Systemic Risk to society”.
Absolutely bonkers that we get to live through all of this!