Why Real-World AI Is Harder Than the Benchmark | EliseAI’s Mario Martone

I did not expect that, but even after coming from Shing Theory, I would say the complexity of the problem of working now is probably higher now than it was before. Mario spent 15 years in theoretical physics studying problems like black holes and string theory.

It goes beyond the title with direct discussion of like, really, right, including: An AI system that works 90% of the time might look impressive in a research paper, but when you're handling millions of conversations about people's housing and healthcare, that re.

1. 01Now he applies that same research mindset to production AI where his team has to decide when to use an LLM when traditional machine learning is actually better and how to evaluate
2. 02They get into Elise AI's voice stack its work fine-tuning open source models and how the company has automated workflows that can take someone from looking for an apartment to tour
3. 03a company building conversational AI for essential industries like housing and healthcare