Because the reality is, as open and philanthropic, they have far more powerful models that they've developed that they just haven't released yet.
Why listen
It goes beyond the title with direct discussion of like, yeah, think, including: If you compare the dollar spend in compute a year ago versus today, their compute that went towards serving models has gone up by 2.3x.
Key takeaways
01Because the reality is, as open and philanthropic, they have far more powerful models that they've developed that they just haven't released yet
02If you compare the dollar spend in compute a year ago versus today, their compute that went towards serving models has gone up by 2.3x
03So embedded in that is basically a 7x efficiency gain in serving inference
Best for
listeners looking for a practical AI episode debrief