Hello everyone! You might / might not have heard Google Pathways Introducing Pathways: A next-generation AI architecture . Google seems to claim that Pathways is some “new” huge huge model which models multiple tasks efficiently. They haven’t released it, however, it seems at first glance they’re es…

Investigating Google Pathways - Switch Transformers (Argmax MoE) + Sharding - Maths behind it

danielhanchen October 31, 2021, 3:19pm 3

Ye sounds about right! It’s quite interesting to see people combine ideas up together!

Introducing Pathways: A next-generation AI architecture

Topic		Replies	Views
Introducing Pathways: A next-generation AI architecture Community	1	1009	November 4, 2021
Exploring Multidimensional Neurons: A Novice's Perspective Community idea , neuromorphic	3	720	December 23, 2023
Everyday objects can run artificial intelligence programs Community	17	1249	February 23, 2022
To scale Gen AI, should we focus on compute or memory Community api	4	814	May 8, 2024
Moonshot - Predicting the future and making JARVIS! Community	67	7326	November 25, 2023