Model routing sounded solved: cheap stuff to the small model, hard stuff to the big one. Turns out that’s how you blow your budget. Tomás Hernando Kofman, founder of Not Diamond, on why naive routing breaks your KV cache, why routing at scale is really a reinforcement learning problem, and why cheaper models mean you spend more, not less.
Speakers
Tomás Hernando Kofman
Co-Founder, CEO @ Not Diamond
Yuval Belfer
Sr. Developer Advocate @ AI21
