SIGNAL//SYNTH
Ai

Memory and Continual Learning: Engram's Dan Biderman and Jessy Lin

aired Jun 24, 2026 · 44.0m
Signal
78.8/ 100
High signal
confidence 0.99
Orig53.8
Actn100.0
Dens100.0
Dpth100.0
Clty80.1
Summary

What about pre-training or even post-training makes it possible for the models to generalize in these magical emergent ways and controlling that process so that a company has a set of private data?. How do we make the models learn that just as well as the models know the capital of France or how to write Python?.

Why listen

It goes beyond the title with direct discussion of like, know, think, including: How do we make the models learn that just as well as the models know the capital of France or how to write Python?.

Key takeaways
  1. 01What about pre-training or even post-training makes it possible for the models to generalize in these magical emergent ways and controlling that process so that a company has a set
  2. 02How do we make the models learn that just as well as the models know the capital of France or how to write Python?
  3. 03Ngram is a neolab focused on memory and continual learning, and two of the hottest topics in all of AI research today
Best for
research-minded practitioners comparing model behavior