When Green Traces Lie: Evaluating Agentic Systems Beyond the Demo
Designed for Engineers and technical leads shipping LLM features.
A practitioner talk about finding failures that successful traces hide. CIBI supplies the real product implementation; cfp-dvma26-eval is a separate public teaching system built with invented data and deterministic mocks.
What the audience leaves with
- 01Design reproducible failure cases
- 02Instrument decisions so bad outputs are explainable
- 03Understand where LLM-as-judge helps and where it can fail