CertBrain
CoursesBlog
Sign in
← Back to decks
Sign in to save your progress, vote, and build your own decks.Sign in

Choosing a Generative AI Model

There's no single best generative AI model, only the best fit for a job. Choosing one means weighing the model type against the task, then performance and capabilities, then constraints such as cost, latency, model complexity and compliance. The exam gives you a scenario with one deciding…

12 cards
Study this deck

Choosing a Generative AI Model

There's no single best generative AI model, only the best fit for a job. Choosing one means weighing the model type against the task, then performance and capabilities, then constraints such as cost, latency, model complexity and compliance. The exam gives you a scenario with one deciding constraint and asks which model or approach fits, so learn what each factor changes.

Start From the Task

The first filter is model type, also called modality: the kind of data a model takes in and produces.

  • Text models (LLMs) read and write language: summaries, answers, drafts, code.
  • Image models, such as diffusion models, create or edit images from text descriptions.
  • Embedding models turn text or images into lists of numbers called vectors, used for similarity search and recommendations. They don't write answers.
  • Multimodal models accept more than one type of input, such as an image plus a question about it.

A model that can't handle the task's data type is ruled out before anything else.

Performance and Capabilities

Next, check whether the model can do the job well enough. Useful questions are: how good are its answers on your own examples, which languages does it handle, and how large is its context window, the amount of text it can consider in one request? A long contract needs a large context window. You should also check whether it can be customized, for example by fine-tuning, if you expect to need that.

Amazon Bedrock's model evaluation feature lets you compare candidate models on your own prompts, using automatic metrics, human reviewers or another model acting as a judge.

Cost, Latency and Complexity

Larger, more complex models, those with more parameters, tend to give richer answers but cost more per request and respond more slowly. Smaller models are cheaper and faster, and often good enough for simple, high-volume tasks. Latency, the time to respond, matters most where a person is waiting, such as a voice assistant. Pick the smallest model that meets your quality bar, not the biggest one available.

Compliance and Data

Regulated businesses must also check:

  • Regional availability: is the model offered in the AWS Region where the data must stay?
  • Data use: with Amazon Bedrock, your prompts and responses aren't used to improve the base models and aren't shared with model providers.
  • Licensing and terms: each model has its provider's terms of use.

A Quick Selection Guide

Requirement in the scenarioPoints toward
Similarity search or recommendationsAn embedding model
Very long documents in one requestA large context window
Instant replies while users waitA smaller, faster model
Tight budget, simple high-volume taskThe smallest model that meets quality
Data must stay in one countryA model available in that Region
Unsure which model is bestCompare candidates with model evaluation

On the Exam

The trap is assuming bigger is always better. If a scenario stresses cost, speed or simple tasks, the answer is usually a smaller model that meets the requirement. If it stresses compliance, look for Region availability and data handling, not model size.

Quiz me on this
A home goods retailer wants shoppers to upload a photo of a lamp and see visually similar lamps from its catalog. The images must first be converted into vectors that can be compared. Which type of model does the retailer need for this step?
  1. A text-generation language model
  2. A diffusion image-generation model
  3. A speech-to-text transcription model
  4. ✓ An embedding model
A fast-food chain is building a voice assistant for its drive-through. Answers are short and simple, such as confirming an order, but each one must come back in about a second or customers get frustrated. Which model choice BEST fits?
  1. The largest available model, for the most detailed possible answers
  2. ✓ A smaller, faster model that is good enough for short answers
  3. The model with the biggest context window, whatever its speed
  4. Batch inference that processes the day's requests overnight
A European health insurer plans to use a third-party foundation model through Amazon Bedrock. Its rules require customer data to stay in an EU Region, and it needs assurance that its prompts won't be used to train the provider's models. Which statement is accurate?
  1. Bedrock shares prompts with the model's provider to improve it, unless the insurer opts out
  2. Every Bedrock model is offered in every Region, so only the price needs comparing
  3. ✓ Confirm the model runs in an EU Region; Bedrock doesn't use prompts to train base models
  4. Third-party models can't meet these rules, so it must pre-train its own model from scratch
A law firm wants a model to summarize contracts that often run to several hundred pages, and each contract must be processed in a single request. Which model characteristic matters MOST for this requirement?
  1. ✓ The model's context window size
  2. Whether it can generate images
  3. The length of its embedding vectors
  4. The lowest temperature it allows
A startup's support assistant handles millions of simple, FAQ-style questions each month on a tight budget. In testing, a small model and the largest model both meet the startup's quality bar, and the small model costs far less per request and responds faster. Which choice is MOST cost-effective?
  1. Use the largest model, since more parameters always means better results
  2. Fine-tune the largest model so it learns the FAQ answers by heart
  3. Pre-train a custom model on the startup's own support tickets
  4. ✓ Use the smaller model, which meets the quality bar for less
A team has narrowed its choice to three foundation models in Amazon Bedrock and wants to compare their answers to the team's own sample prompts before deciding. Which Amazon Bedrock capability is designed for this?
  1. Amazon Bedrock Provisioned Throughput
  2. ✓ Amazon Bedrock Model Evaluation
  3. Amazon Bedrock Guardrails
  4. Amazon Bedrock Knowledge Bases
Modality (model type)
The kind of data a model handles, such as text, images or embeddings. It's the first filter when choosing a model.
Context window
How much text, measured in tokens, a model can consider in one request. Long documents need a large context window.
Model size trade-off
More parameters usually means richer answers but higher cost and slower responses. Choose the smallest model that meets the quality bar.
Inference latency
The time a model takes to return a response. It matters most when a person is waiting, such as in chat or voice assistants.
Amazon Bedrock and your data
Prompts and responses aren't used to improve the base models and aren't shared with model providers.
Amazon Bedrock Model Evaluation
Compares foundation models on your prompts using automatic metrics, human reviewers or a judge model, to help pick the best fit.