Tagged “evaluation”
-
The Five Places a RAG Pipeline Breaks
A bad answer implicates one of five stages. A bisection procedure that finds the responsible one in about ten minutes.
-
Measuring Faithfulness, Not Just Answer Quality
An answer can be good and ungrounded at the same time. How to check every claim against the retrieved context, and where LLM judges fail.
-
Building a Retrieval Eval Set
Golden questions, labelled relevant documents, and the unanswerable cases. How to construct a set that predicts production behaviour.
-
Why Your RAG Demo Works and Production Does Not
The demo and production differ in five specific ways, all of which favour the demo. Each one is measurable before you ship.