Concept 1 of 5

Choosing and configuring a foundation model

4 questions test this

Two decisions sit here. Which model, and how it is configured at the moment of the call.

Choosing the model

Modality comes first and eliminates most candidates. Text in and text out, images in, images out, audio, or some combination. A model that cannot take your input is not a candidate whatever else it does well.

Model size and complexity trade quality against cost and latency. A large model reasons better over hard, open ended work. A small one is faster and dramatically cheaper, and on a narrow task such as classification or extraction it is frequently just as good. The common error is paying frontier prices for work a small model finishes.

Latency is a product constraint. Something a user waits for has a budget of a second or two. A batch job overnight has no such limit, and the right model differs between the two.

Cost is per token, counted separately for input and output, with output usually the dearer. That means cost scales with conversation length and document size rather than with users, which surprises teams used to per seat pricing.

Context length is the ceiling on input plus output. It decides how much you can supply in one call, and it is the constraint that makes retrieval necessary rather than optional on large corpora.

Multilingual capability varies far more between models than the marketing suggests, and tokenisation efficiency varies with it, so the same task can cost more in one language than another.

Customisation is whether the model can be fine tuned at all, and under what licence. Some hosted models cannot be, which forecloses an option you may want later.

Inference parameters

These change the answer without changing the model, and the exam expects you to know which lever does what.

Temperature controls randomness. Near zero, the model repeatedly picks the likeliest next token, giving consistent and conservative output. Higher values flatten the probabilities and admit less likely choices, giving variety and more mistakes. Extraction, classification and anything feeding a downstream system want low. Brainstorming and copy variants want high.

Top p, also called nucleus sampling, restricts the choice to the smallest set of tokens whose probabilities add up to p. It is a different route to the same tradeoff, and tuning both at once makes the effect of either hard to reason about.

Maximum output length caps generation. It protects you from a runaway bill and it truncates, so an answer stopping mid sentence usually means the cap was too low rather than that the model had finished.

Stop sequences end generation when a particular string appears, which is how you keep a model from carrying on past the part you wanted.

Where AWS puts this

Amazon Bedrock provides managed access to foundation models from several providers behind one API, with these parameters exposed per call. SageMaker JumpStart deploys pre trained models into your own account when you need control over hosting. PartyRock is a playground for trying prompts without writing code.

The cost points the exam names for Bedrock are worth knowing. On demand token pricing charges per call. Provisioned throughput reserves capacity for predictable high volume. Custom models carry the cost of the customisation on top. Regional coverage matters where data residency is a constraint, since not every model is offered in every region.

Common misconceptions

The largest model is the safest default.

It is the most expensive and the slowest, and on narrow tasks a smaller model matches it. Model size is a cost and latency decision as much as a quality one, and the usual mistake is paying frontier prices for classification.

Temperature controls how accurate the model is.

It controls randomness in sampling. A low temperature makes the model pick the likeliest continuation more consistently, which reads as more reliable, and it cannot make a model know something it does not.

Maximum output length makes the model write longer answers.

It sets where generation is cut off. Raising it does not produce more content, it only stops truncation, and a response that ends mid sentence usually means the cap was hit rather than that the model finished.

4 questions test this concept

A service extracts the invoice number, date and total from uploaded documents and passes the result to an accounting system. The output must be consistent, because a downstream parser depends on it. Which inference setting is most appropriate?

  • AA temperature at or near zero, so the model consistently picks the likeliest continuation.
  • BA high temperature, so the model considers more possible readings of the document.
  • CA high top p value, to widen the set of tokens the model may choose from.
  • DA raised maximum output length, so the model has room to correct itself.
Check whether it stuck.

One per page, with a worked explanation.

Start the set
Related material
Book
AI Engineering, On model selection as an engineering tradeoff.
Template
RICE scoring sheet, Reach, Impact, Confidence and Effort columns with the score formula built in, defined confidence bands, and a column recording the assumption behind each input.