r/learnAIAgents: how do you check whether a RAG change actually helped?
A retrieval-evaluation practitioner raises a subtle failure mode: the app answers correctly, but citations and logs can't verify which passages supported the claims — a correct answer hiding an evidence gap. The thread converges on a practical rule: log retrieved passages alongside every answer so evals check the citation chain, not just the final text.