CertBrain
CoursesBlog
Sign in
← Back to decks
Sign in to save your progress, vote, and build your own decks.Sign in

Limitations of Generative AI

Generative AI has four weaknesses the exam expects you to recognize from a short scenario: hallucinations, inaccuracy, nondeterminism and limited interpretability. Knowing which one a scenario describes points you to the right fix, whether that's grounding answers in your own data, adjusting…

12 cards
Study this deck

Limitations of Generative AI

Generative AI has four weaknesses the exam expects you to recognize from a short scenario: hallucinations, inaccuracy, nondeterminism and limited interpretability. Knowing which one a scenario describes points you to the right fix, whether that's grounding answers in your own data, adjusting inference settings or keeping a person in the loop.

Hallucinations

A hallucination is output that sounds confident and plausible but is made up: a court case that doesn't exist, a product feature the company never offered, a quote nobody said. It happens because a language model generates the most likely next words, not facts it has checked.

Hallucinations are dangerous precisely because they read well. A user with no reason to doubt the answer may act on it.

Inaccuracy

Inaccuracy is the broader problem of wrong output, whatever the cause. A model's knowledge stops at the date its training data ends, so it may give outdated answers. It can also make arithmetic slips, misread a long document, or repeat errors and biases from its training data. Every hallucination is inaccurate, but not every inaccuracy is a hallucination: an out-of-date answer was once true.

Nondeterminism

Send the same prompt twice and you may get two differently worded answers. That's nondeterminism. A model picks each next word by sampling from a range of likely options, so results vary from run to run.

Inference parameters control how much. A lower temperature makes the model favor its most likely choices, so answers become more consistent. A higher temperature makes them more varied. Even at low settings, identical output isn't guaranteed, so processes that need exactly the same wording every time, such as legal disclosures, should use fixed approved text.

Interpretability

Interpretability means being able to explain how a model reached a particular output. A large model spreads what it has learned across billions of internal values, so nobody can point to the exact reason it produced a sentence. It works like a black box. That's a problem when a business must justify a decision to a customer or a regulator.

Reducing the Risks

WeaknessCommon mitigation
HallucinationRetrieval Augmented Generation (RAG), which supplies the model with your own documents to answer from; Amazon Bedrock Guardrails contextual grounding checks
InaccuracyGrounding in current data, human review, evaluation before launch
NondeterminismLower temperature; fixed text where wording must never change
InterpretabilityKeep people accountable for decisions; prefer explainable models for regulated decisions

A contextual grounding check scores whether a response is supported by the source you supplied and is relevant to the question, and it blocks responses that fall below your threshold. It's designed for summarization, paraphrasing and question answering, not multi-turn chat.

On the Exam

Match the symptom to the word. An invented fact is a hallucination. A different answer each time is nondeterminism. Being unable to say why the output came out that way is interpretability. Then look for the matching fix: grounding for hallucinations, temperature for consistency, human review and explainable models where decisions must be justified.

Quiz me on this
A law firm's research assistant gives a lawyer a court case, complete with a case number, to support an argument. When the lawyer checks, the case doesn't exist. Which limitation of generative AI does this show?
  1. Nondeterminism
  2. Interpretability
  3. ✓ Hallucination
  4. High latency
Two employees at an insurer send the same prompt to the company's writing assistant and get differently worded answers. The compliance team wants the assistant's wording to be as consistent as possible. Which change MOST directly helps?
  1. ✓ Lower the temperature inference parameter
  2. Raise the maximum response length parameter
  3. Switch to a larger model with more parameters
  4. Fine-tune the model on more customer emails
A lender uses generative AI to draft responses to customers' hardship requests. A regulator asks why one draft recommended refusing a request, and the team can't trace which parts of the input led to that wording. Which limitation is the team facing?
  1. Hallucination
  2. A short context window limit
  3. Nondeterminism
  4. ✓ Limited interpretability
An insurer's question-answering tool lets claims staff ask about policy terms, and it sometimes states coverage limits that appear nowhere in the policy documents. The insurer wants answers based only on its own documents, with unsupported answers blocked, and it doesn't want to retrain any model. Which solution BEST meets these requirements?
  1. Fine-tune the model on a large collection of public insurance articles
  2. ✓ Ground answers in its documents and add a contextual grounding check
  3. Raise the temperature so the model explores more possible answers
  4. Switch to a model with a bigger context window and change nothing else
A pharmaceutical company is considering generative AI to produce the dosage instructions printed on medicine labels. Any error could harm patients, and the approved wording must be exactly the same on every label. Which conclusion is MOST appropriate?
  1. ✓ Keep fixed approved text; use AI only for drafts that experts check
  2. Publish the model's output directly, since models are trained on medical text
  3. Use the largest model available, because large models don't hallucinate
  4. Raise the temperature so the model covers more dosage situations
Which statement describes nondeterminism in generative AI?
  1. The model can't show how it reached a particular output
  2. The model states invented facts as if they were true
  3. ✓ The same prompt can produce different outputs on different runs
  4. Answers can be out of date because training data stops at a cutoff date
Hallucination
Confident, plausible-sounding output that is made up, such as an invented source or fact.
Most common type of AI hallucination
A plain factual error, often because the sources a model learned from contradict each other.
Nondeterminism
The same prompt can give different outputs on different runs. A lower temperature reduces this but doesn't guarantee identical output.
Interpretability (as a GenAI limitation)
Large models work like black boxes: it's hard to explain why they produced a particular output.
Contextual grounding check
An Amazon Bedrock Guardrails feature that scores whether a response is grounded in the supplied source and relevant to the query, and blocks low scores.
Main ways to reduce hallucinations
Refine the prompt, give the model relevant data with RAG, or try a different model. A contextual grounding check can also filter ungrounded answers.