Boardroom Answers · AI & Data · AI, Data & Analytics
Garbage in, garbage out. What is the lineage of the "org context" your AI reasons over — where does each input come from, and how would I trace an output back to its inputs?
The question a Chief Data Officer (CDO) asks.
The short answer
Every input to the AI has a typed pipeline and a fingerprint — change your data and stale conclusions are automatically invalidated — and self-reported inputs are visibly discounted against independent evidence.
The full executive answer
The context has a defined pipeline, not a data swamp. Layer by layer: the system identity is fixed text; the organisation context block is built fresh from your database records — your assessment answers, profile, scores — by a single server-side function; the task instruction is per-module template; and retrieval snippets come from documents you uploaded, each chunk stored with its source document identity. Nothing enters a prompt from an untyped side channel, and anything user-written or external passes the neutralisation and PII scrub first.
Traceability runs in both directions. Forward: every stored insight records which model produced it, which provider, token counts, which documents grounded it, and which frameworks it cited. Backward: the caching key is a fingerprint of the exact inputs — organisation context, module, prompt version, model, and the state of your document knowledge base. That last part matters: upload or change a document and the fingerprint changes, which automatically invalidates stale cached analyses. Your data changing forces the conclusions to be recomputed — lineage with teeth.
And we grade our own inputs honestly, which most platforms do not: the Evidence Map classifies every assessment dimension as corroborated, supported, self-reported, or unevidenced, and that classification mechanically adjusts the confidence band on outputs — unresolved conflicts between self-assessment and independent signals widen the band downward and are stamped on the output. Where the current state ends: this is application-level lineage, purpose-built for this pipeline; it is not a general enterprise lineage graph with column-level tracking, and I would not sell it as one.
Grounded in: NIST AI RMF MAP 2.3 / MEASURE 2.1 (data provenance and quality for AI systems); ISO/IEC 42001 Annex A data-management controls; DAMA-DMBOK lineage principles as vocabulary.
The natural next questions
Related governed answers
- Your RAG pulls snippets from my documents into the analysis. How do I know it retrieved the RIGHT passages — and that a bad retrieval doesn’t quietly poison the output?
- Why should I trust this recommendation? Show me WHY the AI said that — can you actually explain a specific output, or is it a black box?
- Is my company’s data used to train your models — or anyone’s models? Where exactly does it go when I click generate?
Want this answered live, on your data?