Hello everyone! You might / might not have heard Google Pathways Introducing Pathways: A next-generation AI architecture . Google seems to claim that Pathways is some “new” huge huge model which models multiple tasks efficiently. They haven’t released it, however, it seems at first glance they’re es…

Investigating Google Pathways - Switch Transformers (Argmax MoE) + Sharding - Maths behind it

danielhanchen October 31, 2021, 3:19pm 3

Ye sounds about right! It’s quite interesting to see people combine ideas up together!

Introducing Pathways: A next-generation AI architecture

Topic		Replies	Views
Introducing Pathways: A next-generation AI architecture Community	1	669	November 4, 2021
Exploring Multidimensional Neurons: A Novice's Perspective Community idea , neuromorphic	3	425	December 23, 2023
Everyday objects can run artificial intelligence programs Community	17	928	February 23, 2022
Moonshot - Predicting the future and making JARVIS! Community	67	5327	November 25, 2023
[hypothesis] finetuning for neural search and robot memory embedding Community	0	349	March 4, 2022