Domain 2 of 6

Suitability and Human Oversight

The judgement that prevents more harm than any control does. What a wrong answer costs, whether a person has to be in the path, and the cases where the honest answer is that this should not be an AI feature.

4
Concepts
~17%
Of the exam
8
Practice questions
Concepts in this domain
01When not to ship an AI featureThe decision that prevents more harm than any control does, and the four situations where the honest answer is that this should not be built.02Human oversightWhat it takes for a person in the loop to be oversight rather than a signature, and the three arrangements worth knowing apart.03Adopting generative AI in a businessMatching a solution type to a business need, the constraints that decide it, the steps to get it into an organisation, and how to measure whether it worked.04Choosing and configuring a foundation modelThe criteria that actually separate one model from another, and what temperature, top p and output length do to the answers you get back.
Try a question from this domain

A team proposes an assistant that tells customers whether their insurance policy covers a given medical procedure. Customers cannot readily judge whether an answer is right. Which consideration should decide whether this is built as described?

  • AThat the reader cannot tell the output is wrong and cannot afford to be wrong, which is the combination that makes it unsafe.
  • BWhether the model achieves above 95 per cent accuracy on the policy documents.
  • CWhether a competitor already offers something similar.
  • DWhether the answers can be generated within an acceptable latency.
8 questions on this domain.

One per page, with a worked explanation.

Start the set