AI Agents Professional Practice Exam Questions and Answers – Part 15/17

Answer: D. Implement structural JSON validation middleware (such as Pydantic) at the tool-calling layer that catches malformed syntax, accompanied by a local retry loop that passes error logs back to the agent for self-healing.

Implementing structural JSON validation middleware catches malformed syntax and enables automated self-correction. This approach ensures robust operations by feeding parsing errors back to the agent, allowing it to heal execution faults dynamically.

Answer: D. It means the evaluation or test dataset contaminated the training dataset, resulting in artificially high performance during validation but poor generalization in real-world deployment.

Data leakage means evaluation data has contaminated the training set, yielding falsely high validation metrics. This leads to poor generalization during live deployment because the model essentially memorized the test answers.

Answer: D. Representatives from Legal/Compliance, Cybersecurity, Data Science Engineering, Product Management, and an Executive Sponsor (such as the CTO or Chief Risk Officer).

An effective governance council requires cross-functional stakeholders from legal, security, engineering, and product management. This diverse representation ensures deployments balance technical utility with legal compliance and security.

Answer: C. Direct Preference Optimization (DPO) or Proximal Policy Optimization (PPO) using a curated dataset of safe, aligned corporate conversation interactions.

Direct Preference Optimization and Proximal Policy Optimization are standard mathematical preference alignment algorithms used to update model weights. They reward constructive completions while systematically penalizing toxic conversational trajectories.

Answer: C. Malicious actors can inject structured, false financial context into public feeds, poisoning the vector index and systematically manipulating the model's downstream recommendations without altering base weights.

Ingesting unverified public feeds allows malicious actors to inject structured false context into the vector index. This data poisoning systematically manipulates the model's downstream recommendations without requiring base weight alterations.

Answer: A. Utilize an automated evaluation framework such as Ragas or TruLens to calculate explicit factual alignment scores, semantic answer relevance, and context grounding ratios using an LLM-as-a-judge paradigm.

Automated evaluation frameworks like Ragas or TruLens use an LLM-as-a-judge paradigm to calculate factual alignment and context grounding. Programmatic validation scores are necessary because manual human review cannot scale to enterprise volumes.

Answer: A. Implement a strict data lifecycle and content governance workflow that enforces metadata timestamping, semantic version controls on all vector database embeddings, and automated pruning of deprecated documents.

Implementing strict data lifecycle workflows with metadata timestamping and semantic version controls prevents outdated retrieval. Automated pruning of deprecated documents ensures the vector index only contains active corporate guidelines for generation.

Answer: C. An attacker inputs highly complex, carefully crafted recursive prompts designed to force an expensive frontier model into generating maximum-length completions, draining the enterprise's financial budget.

A Denial of Wallet attack forces an expensive frontier model to generate maximum-length completions using recursive prompts. This financial exhaustion vector drains the enterprise budget by spiking operating costs through excessive token processing.

Answer: C. Configure the company's network security perimeter with Data Loss Prevention (DLP) filters that intercept outbound traffic to known model endpoints, paired with an enterprise-managed internal LLM gateway that enforces zero data retention.

Data Loss Prevention filters intercept outbound traffic to external model endpoints, stopping source code leaks. Pairing these filters with an internal enterprise gateway allows safe access while enforcing strict zero data retention compliance rules.

Answer: C. They are attempting to reconstruct the original plain-text sensitive user profiles from the mathematical floating-point vector arrays stored in the database.

The correct option accurately describes inversion attacks, where attackers reconstruct sensitive plaintext data from numerical vector arrays. Remember that embeddings are reversible mathematical representations, not secure one-way hashes, requiring strict access controls to protect user privacy.

Answer: C. Implement document access control metadata tagging at the data ingestion layer, forcing the vector database retrieval query to filter matches based on the authenticated user's active security group tokens before passing context to the LLM.

The correct option solves this by filtering vector database matches against the authenticated user's security tokens during retrieval. Relying solely on system prompts to ignore confidential files fails because models lack implicit access control boundaries without explicit metadata enforcement.

Answer: B. Deploy a multi-region endpoint strategy using smaller, localized open-source model mirrors (e.g., 8B parameter models) on edge clusters for routine writing tasks, combined with a centralized fallback router to a frontier model cluster for complex campaigns.

The correct answer highlights that deploying smaller localized models at the edge minimizes network transit latency for global users. Routing complex requests to a centralized frontier cluster ensures high-quality outputs while maintaining strict control over operational infrastructure costs.

Answer: D. Log all user inputs and generated completions to a secure, centralized observability platform (such as LangSmith or Arize), tracking semantic embedding distributions, latency percentiles, token costs, and user feedback signals.

The correct option identifies that centralized observability platforms track semantic drift, costs, and latencies to maintain production health. Adjusting the temperature or stripping punctuation does not provide the telemetry needed to detect structural degradation over time.

Answer: B. Implement a robust session management architecture within the orchestration layer that strictly segregates short-term memory stores, applies unique cryptographic identifiers to individual user sessions, and enforces state cleaning on disconnect.

The correct answer resolves cross-contamination by enforcing strict session isolation and applying unique cryptographic identifiers within memory stores. Altering database indices or modifying JSON transport formats does not address the core orchestration flaw causing concurrent memory bleeding.

Answer: D. Enforce mandatory TLS 1.3 encryption for all data-in-transit, authenticate sessions via securely managed API keys stored in an enterprise vault, and verify the endpoint provider's SOC 2 Type II certification.

The correct option secures data-in-transit using TLS 1.3 and protects credentials via enterprise vaults to meet compliance. Hardcoding API keys directly into system prompts is a severe vulnerability that immediately exposes critical infrastructure to unauthorized access.

Answer: D. Risk of caching outdated information or leaking sensitive user records across distinct sessions; addressed by implementing strict Time-to-Live (TTL) expirations and access token namespace separation.

The correct choice identifies that semantic caches risk exposing private histories and returning outdated data across sessions. Implementing strict TTL expirations and namespace separation effectively isolates users, preventing sensitive information cross-contamination in caching layers.

Answer: D. A strict Human-in-the-Loop (HITL) authorization gate that blocks execution of any mutating financial tool until a certified employee verifies and clicks approval.

High-risk autonomous operations require manual intervention boundaries. Incorporating human-in-the-loop validation layers ensures human oversight blocks catastrophic or hallucinated model transactions. Modifying generation parameters or transport protocols cannot replace mandatory operational sign-offs.

Answer: B. A dedicated pre-processing data sanitization middleware layer executing Named Entity Recognition (NER) models paired with regular expression scanners to redact sensitive tokens before payload transmission.

A dedicated pre-processing data sanitization middleware layer uses Named Entity Recognition and regex scanners to redact sensitive tokens. This intercepts private data before network transmission, ensuring outbound payloads remain secure and compliant.