Two decisions sit here. Which model, and how it is configured at the moment of the call.
Choosing the model
Modality comes first and eliminates most candidates. Text in and text out, images in, images out, audio, or some combination. A model that cannot take your input is not a candidate whatever else it does well.
Model size and complexity trade quality against cost and latency. A large model reasons better over hard, open ended work. A small one is faster and dramatically cheaper, and on a narrow task such as classification or extraction it is frequently just as good. The common error is paying frontier prices for work a small model finishes.
Latency is a product constraint. Something a user waits for has a budget of a second or two. A batch job overnight has no such limit, and the right model differs between the two.
Cost is per token, counted separately for input and output, with output usually the dearer. That means cost scales with conversation length and document size rather than with users, which surprises teams used to per seat pricing.
Context length is the ceiling on input plus output. It decides how much you can supply in one call, and it is the constraint that makes retrieval necessary rather than optional on large corpora.
Multilingual capability varies far more between models than the marketing suggests, and tokenisation efficiency varies with it, so the same task can cost more in one language than another.
Customisation is whether the model can be fine tuned at all, and under what licence. Some hosted models cannot be, which forecloses an option you may want later.
Inference parameters
These change the answer without changing the model, and the exam expects you to know which lever does what.
Temperature controls randomness. Near zero, the model repeatedly picks the likeliest next token, giving consistent and conservative output. Higher values flatten the probabilities and admit less likely choices, giving variety and more mistakes. Extraction, classification and anything feeding a downstream system want low. Brainstorming and copy variants want high.
Top p, also called nucleus sampling, restricts the choice to the smallest set of tokens whose probabilities add up to p. It is a different route to the same tradeoff, and tuning both at once makes the effect of either hard to reason about.
Maximum output length caps generation. It protects you from a runaway bill and it truncates, so an answer stopping mid sentence usually means the cap was too low rather than that the model had finished.
Stop sequences end generation when a particular string appears, which is how you keep a model from carrying on past the part you wanted.
Where AWS puts this
Amazon Bedrock provides managed access to foundation models from several providers behind one API, with these parameters exposed per call. SageMaker JumpStart deploys pre trained models into your own account when you need control over hosting. PartyRock is a playground for trying prompts without writing code.
The cost points the exam names for Bedrock are worth knowing. On demand token pricing charges per call. Provisioned throughput reserves capacity for predictable high volume. Custom models carry the cost of the customisation on top. Regional coverage matters where data residency is a constraint, since not every model is offered in every region.