Amazon Web Services Updated AIF-C01 Exam Questions and Answers by hubert

Sentiment analysis is the task of determining the emotional tone or intent behind a body of text (positive, negative, neutral).

This falls under Natural Language Processing (NLP) because it deals with understanding and processing human language.

Computer vision relates to images, robotics to autonomous machines, and time series forecasting to predicting values from sequential data.

???? Reference:

AWS ML Glossary – NLP

To securely use large language models (LLMs) on Amazon Bedrock, companies should design clear and specific prompts to avoid unintended outputs and ensure proper configuration of AWS Identity and Access Management (IAM) roles and policies with the principle of least privilege. This approach limits access to sensitive resources and minimizes the potential impact of security incidents.

Option A (Correct): "Design clear and specific prompts. Configure AWS Identity and Access Management (IAM) roles and policies by using least privilege access": This is the correct answer as it directly addresses both security practices in prompt design and access management.

Option B: "Enable AWS Audit Manager for automatic model evaluation jobs" is incorrect because Audit Manager is for compliance and auditing, not directly related to secure LLM usage.

Option C: "Enable Amazon Bedrock automatic model evaluation jobs" is incorrect because Bedrock does not provide automatic model evaluation jobs specifically for security purposes.

Option D: "Use Amazon CloudWatch Logs to make models explainable and to monitor for bias" is incorrect because CloudWatch Logs are used for monitoring and not directly for making models explainable or secure.

AWS AI Practitioner References:

Secure AI Practices on AWS: AWS recommends configuring IAM roles and using least privilege access to ensure secure usage of AI models.

The correct answer is C – Re-train the model with fresh data. AWS SageMaker Model Monitor is designed to detect data drift, feature drift, and model quality degradation in real-time. When drift exceeds a set threshold, AWS recommends initiating a retraining workflow with updated data to restore model accuracy. According to AWS documentation, data drift indicates that the distribution of incoming data has changed significantly from the original training dataset—often due to new user behaviors, market changes, or seasonal patterns. Restarting the endpoint (A) does not address degraded model performance. Adjusting sensitivity (B) suppresses the alert but does not fix the underlying issue. Experiments tracking (D) is helpful for monitoring model versions but is not corrective. Retraining ensures the model adapts to new data patterns and continues to perform reliably, which is the AWS-endorsed response to drift detection alerts.

Referenced AWS Documentation:

Amazon SageMaker Model Monitor – Detecting Drift

AWS ML Ops Best Practices – Continuous Retraining

Hallucinations in large language models (LLMs) occur when the model generates outputs that are factually incorrect, irrelevant, or not grounded in the input data. To mitigate hallucinations, adjusting the model's inference parameters, particularly the temperature, is a well-documented approach in AWS AI Practitioner resources. The temperature parameter controls the randomness of the model's output. A lower temperature makes the model more deterministic, reducing the likelihood of generating creative but incorrect responses, which are often the cause of hallucinations.

Exact Extract from AWS AI Documents:

From the AWS documentation on Amazon Bedrock and LLMs:

"The temperature parameter controls the randomness of the generated text. Higher values (e.g., 0.8 or above) increase creativity but may lead to less coherent or factually incorrect outputs, while lower values (e.g., 0.2 or 0.3) make the output more focused and deterministic, reducing the likelihood of hallucinations."

(Source: AWS Bedrock User Guide, Inference Parameters for Text Generation)

Detailed Explanation:

Option A: Set up Agents for Amazon Bedrock to supervise the model training.Agents for Amazon Bedrock are used to automate tasks and integrate LLMs with external tools, not to supervise model training or directly address hallucinations. This option is incorrect as it does not align with the purpose of Agents in Bedrock.

Option B: Use data pre-processing and remove any data that causes hallucinations.While data pre-processing can improve model performance, identifying and removing specific data that causes hallucinations is impractical because hallucinations are often a result of the model's generative process rather than specific problematic data points. This approach is not directly supported by AWS documentation for addressing hallucinations.

Option C: Decrease the temperature inference parameter for the model.This is the correct approach. Lowering the temperature reduces the randomness in the model's output, making it more likely to stick to factual and contextually relevant responses. AWS documentation explicitly mentions adjusting inference parameters like temperature to control output quality and mitigate issues like hallucinations.

Option D: Use a foundation model (FM) that is trained to not hallucinate.No foundation model is explicitly trained to "not hallucinate," as hallucinations are an inherent challenge in LLMs. While some models may be fine-tuned for specific tasks to reduce hallucinations, this is not a standard feature of foundation models available on Amazon Bedrock.