Boardroom Answers · AI & Data · AI, Data & Analytics
Your RAG pulls snippets from my documents into the analysis. How do I know it retrieved the RIGHT passages — and that a bad retrieval doesn’t quietly poison the output?
The question a Chief Data Officer (CDO) asks.
The short answer
Retrieval is reranked by a dedicated relevance model, every output names its source documents, retrieved text is treated as hostile until neutralised — and honest gap: labelled retrieval benchmarks are being built from live feedback, not claimed.
The full executive answer
Let me translate the pipeline first: when you upload a document, we split it into passages, convert each into a numeric meaning-fingerprint — an embedding — and store those in a vector database inside your tenant. At generation time the engine searches those fingerprints for passages relevant to the module and your context, and where configured, a second-stage reranker — a cross-encoder model whose whole job is relevance judgment — re-scores a candidate pool of thirty before the best snippets are used. Fusion of ranking signals and the reranker exist precisely because raw similarity search alone is not good enough.
Against quiet poisoning, three controls. Retrieved text is treated as attacker-reachable — it passes the same injection-neutralisation as any untrusted input, and our red-team suite includes poisoned-document scenarios that must be detected and fenced as data. Attribution is explicit: every insight lists its grounded source documents by name, so a wrong-document retrieval is visible, not silent. And the retrieval layer is fingerprinted into the cache key, so a changed document library forces regeneration rather than serving conclusions grounded in deleted or superseded files.
Honest depth statement: we have a retrieval evaluation scaffold and the feedback loop feeds it, but we do not yet have large human-labelled retrieval gold sets or published recall metrics — that is roadmap, and the feedback capture is deliberately designed to build those sets from real usage. What I can demonstrate today is the attribution, the reranking, and the poisoning defences, live.
Grounded in: OWASP LLM Top 10 — LLM08/training-data & retrieval poisoning class, LLM01 indirect injection via retrieved content; NIST AI RMF MEASURE 2.5 (validity of system components).
The natural next questions
Related governed answers
- Garbage in, garbage out. What is the lineage of the "org context" your AI reasons over — where does each input come from, and how would I trace an output back to its inputs?
- Why should I trust this recommendation? Show me WHY the AI said that — can you actually explain a specific output, or is it a black box?
- Is my company’s data used to train your models — or anyone’s models? Where exactly does it go when I click generate?
Want this answered live, on your data?