Isaca Updated AAIA Exam Questions and Answers by ela

If the combined size of the training, validation, and testing sets exceeds the original data size, it suggests that records may have been reused across sets. This can lead to data leakage, where the model has access to test or validation information during training, resulting in overly optimistic performance metrics.

“Data leakage invalidates model evaluation because it introduces unintended data overlap. Auditors must ensure that the training, validation, and test sets are strictly partitioned.”

Options A, C, and D refer to process order or quantity, but only B addresses the root issue of compromised model integrity due to overlapping data.

Only reviewing an ML model’s performance one time prior to migrating to production (option C) is of greatest concern. The AAIA™ Study Guide emphasizes that “AI and ML models require continuous monitoring and periodic performance reviews in production to detect issues such as data drift, model degradation, or evolving risk factors.” A single pre-production review fails to capture these changes and risks, potentially resulting in undetected failures or compliance issues.

Periodic (including annual) and event-driven reviews are necessary to ensure ongoing model reliability.

The AAIA™ Study Guide advises that if an AI model presents a risk that exceeds the organization ' s predefined risk tolerance—especially in cases of ethical harm or bias—deployment should be delayed until proper safeguards are in place. This approach prevents legal exposure and preserves stakeholder trust.

“When AI risks exceed acceptable thresholds, organizations must suspend implementation until corrective action reduces the risk to within tolerance levels. Proceeding without mitigation violates sound governance principles.”

While improving data (B) may help, it does not address the immediate governance concern. Risk tolerance (D) should not be adjusted to fit flawed systems. Thus, A is the correct course.

Audit interviews often contain highly sensitive, proprietary, or even non-public information. Uploading these recordings to a cloud provider introduces the " Risk of unauthorized access " by the vendor ' s employees or through a security breach at the vendor ' s site. According to ISACA, the loss of " Confidentiality " over audit workpapers is a critical failure of professional standards. While inaccurate transcriptions (Option D) are a nuisance, they can be corrected by the auditor; however, once sensitive data is compromised by a third party, the damage is irreversible. Auditors must ensure the vendor has rigorous " encryption " and " at-rest " security attestations.