CertBrain
CoursesBlog
Sign in
← Back to decks
Sign in to save your progress, vote, and build your own decks.Sign in

Data Lineage and Source Citation

When an AI system makes a decision or writes an answer, people eventually ask where it came from. Which data trained this model? Who approved it, and for what use? Which document backs up this answer? Being able to reply is called provenance, and it matters for audits, for fixing problems and for…

8 cards
Study this deck

Data Lineage and Source Citation

When an AI system makes a decision or writes an answer, people eventually ask where it came from. Which data trained this model? Who approved it, and for what use? Which document backs up this answer? Being able to reply is called provenance, and it matters for audits, for fixing problems and for user trust. The exam expects you to know the AWS tools that record it: the AWS Glue Data Catalog for data, SageMaker AI lineage tracking and Model Cards for models, and citations for generated answers.

Lineage and Provenance

Data lineage is the record of where data came from and what was done to it along the way: which sources fed a dataset, which jobs transformed it, and which models were trained on the result. Provenance is the broader idea of knowing an item's origin. Together they let a team answer an auditor's question with evidence instead of memory, trace a bad prediction back to a faulty data source, and retrain a model the same way later. Lineage is easiest to keep when tools record it automatically as work happens, rather than relying on people to write it down afterwards.

Cataloging Data

You can't trace data you can't find. The AWS Glue Data Catalog is a central store of metadata about your datasets: where each one lives, its schema and its properties. Crawlers scan sources such as Amazon S3, Amazon RDS and Amazon Redshift and fill in the catalog automatically, so it stays current as data changes. The catalog also keeps lineage information about the transformations applied to data, and it works with AWS Lake Formation for fine-grained access control. Services such as Amazon Athena and SageMaker AI can use the same catalog, so everyone works from one description of the data.

Tracking and Documenting Models

SageMaker AI ML Lineage Tracking records the steps of a machine learning workflow, from data preparation to deployment. It tracks training jobs, the datasets they used, pipelines, endpoints and the models themselves, so you can look up exactly which artifacts produced a model and reproduce it.

Amazon SageMaker Model Cards are the human-readable side. A model card documents a model in one place: its intended uses and the uses it isn't meant for, a risk rating (unknown, low, medium or high), training details and metrics, evaluation results, and notes such as ethical considerations. Every edit other than an approval-status change creates a new version, giving an unchanging history, and a card can be exported as a PDF for auditors. Model Cards also connect to the SageMaker Model Registry, where model versions are tracked.

Citing Sources in Answers

Generated answers need provenance too. When an application uses Retrieval Augmented Generation (RAG) through Amazon Bedrock Knowledge Bases, the response comes back with citations: each part of the answer is linked to the source chunks it drew on, with the location of the original document, such as its S3 path. An application can show these as footnotes so users can check the answer against the source. Citations don't make an answer correct on their own, but they make it checkable, which is what a regulated business usually needs.

On the Exam

Match the question to the record it needs:

NeedTool
Find datasets, their schemas and where they liveAWS Glue Data Catalog
Show which data and training job produced a modelSageMaker AI ML Lineage Tracking
Document a model's purpose, risk and evaluation for reviewersSageMaker Model Cards
Let users see which document an answer came fromKnowledge Bases citations

A common trap is choosing a guardrail's contextual grounding check when users must see the source. The check can block unsupported answers, but it doesn't show the user where an answer came from.

Quiz me on this
A company's data teams keep losing time hunting for datasets spread across Amazon S3 and Amazon RDS. They want one searchable inventory of every dataset, with its schema and location, kept up to date automatically. Which AWS capability meets this need?
  1. SageMaker Model Cards for each dataset
  2. AWS CloudTrail logs of S3 and RDS activity
  3. An Amazon Bedrock knowledge base over the buckets
  4. ✓ The AWS Glue Data Catalog with crawlers
A bank's model risk team requires, for every model, a single record of its intended uses, uses it must not be put to, a risk rating and its evaluation results. The record must keep an unchanging history of edits for auditors. Which AWS feature should the bank use?
  1. The AWS Glue Data Catalog
  2. ✓ SageMaker Model Cards
  3. AWS CloudTrail event history
  4. Amazon Bedrock Prompt Management
A hospital is building an assistant that answers staff questions from its clinical policy documents. Staff must be able to see which policy document each answer came from, so they can check it before acting. Which approach meets this requirement?
  1. ✓ Use a Bedrock knowledge base and show its citations
  2. Fine-tune a model on the policy documents so it learns them
  3. Add a guardrail contextual grounding check to the responses
  4. Lower the model's temperature so its answers are more consistent
Data lineage
The record of where data came from and what was done to it, so you can audit, trace problems and reproduce a model.
AWS Glue Data Catalog
A central store of dataset metadata (location, schema, properties), kept current by crawlers and shared by services such as Athena and SageMaker AI.
SageMaker AI ML Lineage Tracking
Records ML workflow steps, linking datasets, training jobs, models and endpoints, so you can see what produced a model and reproduce it.
Amazon SageMaker Model Cards
Versioned documentation of a model: intended uses, risk rating, training details and evaluation results. Exportable as a PDF for audits.
Citations in Bedrock Knowledge Bases
Links returned with a generated answer that tie each part to the source chunks and original document location it drew on.