Nested Learning: Ali Behrouz on the Quest for Continual Learning & Illusion of AI Architectures

Hello, and welcome back to The Cognitive Revolution.

It goes beyond the title with direct discussion of like, know, model, including: Today, I'm excited to share a conversation with Ali Beirouz, grad student at Cornell, researcher at Google, and author of Nested Learning.

1. 01Arguably, it is the main gap between today's models and a digital AGI that would be capable of joining and contributing to human teams just as humans do
2. 02His blockbuster paper, Nested Learning, which has been touted as a harbinger of a possible paradigm shift by no less than Jeff Dean, develops a simple strategy that allows models t
3. 03His latest work, Language Models Need Sleep, Learning to Self-Modify and Consolidate Memories, which I actually heard about live for the first time on this recording, and which has