Retrieval Grounding & Citation Evaluator
Tests whether retrieval finds the right evidence and generated claims remain supported by it.
Separates retrieval failure from generation failure, checks citation entailment at claim level, tests stale, conflicting and access-controlled sources, and measures when the system should abstain. It reports source coverage and unsupported claims rather than a single opaque groundedness percentage.
Authority
Inform
Team role
Provides specialist analysis
Handoffs
Named collaborators
The role
What it owns and where its authority ends
Desk
Generative AI, Retrieval & Adversarial Testing
Desk workflow
Threat and quality plan, then a prompt-injection campaign, then retrieval and citation tests, then factuality review, then consolidated release findings.
Collaboration
Works within a defined desk workflow
Decision boundary
Provides evidence or analysis without committing the decision.
Systems and capabilities involved
Versioned vector index
Source-of-truth document store
Claim and citation parser
Entitlement simulator
Handoffs
What this role gives and receives
Capabilities offered
Test retrieval grounding and citations
Measure retrieval, citation support, freshness, conflicts and access boundaries.
- Receives:
- Question set, corpus snapshot, index configuration and entitlement profiles
- Returns:
- Claim-level grounding, retrieval defects, abstention and access-control findings
Handoff to
Handoff to
Receives from
External handoff
Knowledge owner
External handoff
Data platform
External handoff
Access governance
Context
What the role needs to do the work
- Current work
- Question set, index snapshot, retrieved passages, claims and citations.
- Prior interactions
- Prior retrieval regressions, stale sources and access leaks.
- Policies and reference
- Corpus taxonomy, entitlement model and citation standards.
- Working method
- Retrieval recall, entailment and abstention tests.
Illustrative workflow
How the work moves
Starting point
A compliance assistant moves to a newly rebuilt regulatory index.
- 01
Pin old and new index snapshots and run the sealed jurisdiction question set.
- 02
Score retrieval recall, source freshness, claim entailment and entitlement behavior.
- 03
Localize a regression to chunking of amendment tables.
Result
A grounding report with one release-blocking retrieval regression and exact affected sources.
Checks and boundaries
What must be tested or reviewed
- 01Attributes a missing answer to retrieval when the source exists yet stays outside the retrieved context.
- 02Flags a fluent answer whose citation is topically related but fails to support the amount claimed.
- 03Verifies that a lower-entitlement user cannot retrieve a restricted policy fragment.
Human authority
- Knowledge owner signs source-of-truth corpus
- Access governance approves entitlement test matrix
Keep exploring