Amazon Web Services Updated AIF-C01 Exam Questions and Answers by cobie

Building and training a generative AI model from scratch provides the company with the most ownership and control over security responsibilities. In this scenario, the company is responsible for all aspects of the security of the data, the model, and the infrastructure.

Option D (Correct): "Building and training a generative AI model from scratch by using specific data that a customer owns": This is the correct answer because it involves complete ownership of the model, data, and infrastructure, giving the company the highest level of responsibility for security.

Option A: "Using a third-party enterprise application that has embedded generative AI features" is incorrect as the company has minimal control over the security of the AI features embedded within a third-party application.

Option B: "Building an application using an existing third-party generative AI foundation model (FM)" is incorrect because security responsibilities are shared with the third-party model provider.

Option C: "Refining an existing third-party generative AI FM by fine-tuning the model with business-specific data" is incorrect as the foundation model and part of the security responsibilities are still managed by the third party.

AWS AI Practitioner References:

Generative AI Security Scoping Matrix on AWS: AWS provides a security responsibility matrix that outlines varying levels of control and responsibility depending on the approach to developing and using AI models.

The correct answer is A because Amazon SageMaker Canvas is designed specifically for users with little or no machine learning or programming experience. It provides a visual interface to build ML models by simply uploading data, performing analysis, and generating predictions using a no-code environment.

From the AWS documentation:

"Amazon SageMaker Canvas enables business analysts and other users to generate accurate ML predictions using a visual, point-and-click interface without writing code or having prior ML experience."

This feature allows the user to:

Import datasets (e.g., HR data)

Automatically explore the data

Select the prediction column (e.g., attrition)

Train the model

Generate and export predictions

Explanation of other options:

B. SageMaker Clarify is used to detect bias and explain ML predictions but not to build models or make predictions without code.

C. SageMaker Model Monitor monitors model quality in production but doesn’t build or train models.

D. SageMaker Data Wrangler is used for data preprocessing and transformation but still requires some technical configuration.

Referenced AWS AI/ML Documents and Study Guides:

Amazon SageMaker Canvas Developer Guide

AWS Certified Machine Learning Specialty Study Guide – AutoML and No-Code Tools Section

AWS Machine Learning Blog: “Predict Employee Attrition with SageMaker Canvas”

Amazon Bedrock Agents provide the capability to automate repetitive tasks and orchestrate complex workflows using generative AI models. This is particularly beneficial for customer support inquiries, where quick and efficient processing is crucial.

Option B (Correct): "Automation of repetitive tasks and orchestration of complex workflows": This is the correct answer because Bedrock Agents can automate common customer service tasks and streamline complex processes, improving response times and efficiency.

Option A: "Generation of custom foundation models (FMs) to predict customer needs" is incorrect as Bedrock agents do not create custom models.

Option C: "Automatically calling multiple foundation models (FMs) and consolidating the results" is incorrect because Bedrock agents focus on task automation rather than combining model outputs.

Option D: "Selecting the foundation model (FM) based on predefined criteria and metrics" is incorrect as Bedrock agents are not designed for selecting models.

AWS AI Practitioner References:

Amazon Bedrock Documentation: AWS explains that Bedrock Agents automate tasks and manage complex workflows, making them ideal for customer support automation.

Comprehensive and Detailed Explanation From Exact AWS AI documents:

In Amazon Bedrock evaluations, Completeness measures how thoroughly a model or agent response addresses all aspects of the user prompt.

AWS evaluation guidance for LLM-as-a-judge explains that:

Completeness focuses on coverage of prompt requirements

It is especially useful for evaluating multi-part questions

It is a built-in qualitative metric in agent evaluation workflows

Why the other options are incorrect:

ROUGE (A) measures text overlap, mainly for summarization.

Following instructions (C) evaluates adherence, not coverage.

Refusal (D) measures appropriate refusal behavior.

AWS AI document references:

Amazon Bedrock Model Evaluation

LLM-as-a-Judge Metrics

Evaluating Agent Responses on AWS