RAG retrieves documents but gives wrong answers

Finding documents does not guarantee a correct answer. Inspect evidence, context, and generation separately.

Check whether retrieved content is relevant

Shared keywords do not establish that a passage answers the question. Check whether chunking lost conditions, dates, or permissions.

Inspect the actual model context

Confirm the passages, sources, and ordering actually sent to the model. Require abstention when evidence is insufficient instead of filling gaps with general knowledge.

Retest the same question set

Record retrieval, citation, and answer correctness separately. Change one factor at a time, compare the baseline, and keep regressions.

Updated: 2026-10-10 · Verify these methods against actual projects.