SIGNAL//SYNTH
Ai

1046: Weighing a Feather: How to Design A/B Tests That Work, with Billur Engin

aired Nov 20, 2026 · 24.0m
Signal
87.5/ 100
Essential
confidence 0.99
Orig57.2
Actn100.0
Dens100.0
Dpth100.0
Clty60.4
Summary

Too many of the A-B tests that we run are never going to tell you anything. They're like bathroom scales trying to weigh a feather.

Why listen

It goes beyond the title with direct discussion of data, like, it's, including: They're like bathroom scales trying to weigh a feather.

Key takeaways
  1. 01Too many of the A-B tests that we run are never going to tell you anything
  2. 02In her first ever podcast appearance, Biller explains why complexity has to earn its place in your models, why the experiment you don't run is the most costly one, and why causal i
  3. 03And so we've got a great conversation ahead on data science methodology, A testing causal inference decision at scale And so yeah really appreciate you coming on and us being able
Best for
listeners looking for a practical AI episode debrief