Professional Machine Learning Engineer

Question 1

A retail chain wants to classify products on store shelves using cameras that operate in stores with unreliable internet connectivity. The data science team has limited ML coding experience but has thousands of labeled product images. They need a solution that trains a custom image classifier and can run inference directly on in-store edge devices without a constant network connection. Which approach best meets these requirements?

Accepted Answer

Train a custom model with Vertex AI AutoML Image Classification using the 'Edge' model type, then export the model to run on the in-store devices.

Answer

Use the Cloud Vision API label detection endpoint from each in-store device to classify products in real time.

Answer

Train a Vertex AI AutoML Image Classification model with the 'Cloud' hosted model type and call its online prediction endpoint from the devices.

Answer

Build a custom TensorFlow CNN in Vertex AI Workbench notebooks and containerize it for edge deployment.

Question 2

A fintech company wants to build a binary classification model in Vertex AI AutoML Tabular to detect fraudulent transactions. Only 0.8% of the labeled transactions are fraudulent. The team's priority is to catch as many actual fraud cases as possible while keeping false positives at a manageable level, and they have limited ML expertise. Which approach should they configure to best meet this goal?

Accepted Answer

Train the AutoML Tabular model and set the optimization objective to maximize the area under the precision-recall curve (AU PRC).

Answer

Train the AutoML Tabular model with the default optimization objective of maximizing the area under the ROC curve (AU ROC).

Answer

Manually downsample the majority class to a 50/50 balance before training and optimize for overall accuracy.

Answer

Switch to a BigQuery ML logistic regression model and optimize for log loss since AutoML cannot handle imbalanced data.

Question 3

A logistics company wants to predict package delivery times using a structured dataset in Vertex AI. The data science team has limited coding experience and needs a solution that requires minimal ML expertise. Business stakeholders also require the model to report which features most influence each individual prediction, and the model must be queried in real time from a customer-facing web application. Which approach best meets all requirements?

Accepted Answer

Train an AutoML tabular regression model in Vertex AI, deploy it to an online endpoint, and enable Vertex Explainable AI feature attributions on the predictions.

Answer

Train a custom TensorFlow regression model with a hand-written training loop and serve it via a Compute Engine VM.

Answer

Train an AutoML tabular regression model in Vertex AI and use only batch prediction jobs to generate delivery time estimates.

Answer

Use BigQuery ML to train a linear regression model and export it to a TensorFlow SavedModel for local inference.

Question 4

A marketing analytics team with limited ML expertise wants to build a churn prediction model from a customer table already in BigQuery. They choose Vertex AI AutoML Tabular through the console. During job configuration, they must set a training budget expressed in node hours. They ask you how this setting affects the outcome and how to choose a reasonable value for their first experiment. What is the most accurate guidance?

Accepted Answer

The budget caps the maximum compute AutoML spends searching architectures and tuning; AutoML may stop early if the model converges, and a small budget is appropriate for an initial baseline experiment.

Answer

The budget sets the number of prediction nodes for the deployed endpoint, so it should match expected serving traffic rather than training needs.

Answer

The budget determines how many rows of the dataset AutoML uses for training, so a higher budget always means more data is included.

Answer

The budget is a hard minimum runtime; AutoML will always consume the entire allocation even if the model has already converged, so it should be set as low as possible to save money.

Question 5

A sports media company wants to automatically tag short game clips with the specific athletic actions they contain (e.g., 'shot on goal', 'free kick', 'tackle') along with the time segments where each action occurs. The data science team has only a few weeks, limited ML expertise, and a labeled dataset of a few thousand video clips. They want the lowest-code approach on Google Cloud that produces temporal action segments. Which solution best fits these requirements?

Accepted Answer

Use AutoML (Vertex AI) to train an action recognition video model on the labeled clips

Answer

Use the Vision API's label detection endpoint on sampled frames from each clip

Answer

Write a custom PyTorch 3D-CNN training job on Vertex AI custom training with a GPU cluster

Answer

Use the Video Intelligence API's prebuilt label detection to identify actions

Question 6

Your team serves a product recommendation model on a Vertex AI online endpoint. Each request requires computing dense embeddings for a fixed catalog of 2 million products, then scoring the user against those embeddings. The catalog changes only once per day. Currently, product embeddings are recomputed on every request, causing p95 latency to exceed 800 ms and driving up GPU costs. You must reduce online latency while keeping recommendations fresh within one day. What is the best approach?

Accepted Answer

Precompute all product embeddings in a nightly batch prediction job, store them in a low-latency store (e.g., Vertex Feature Store or a vector index), and have the online endpoint only compute the user embedding and perform the lookup/scoring at request time.

Answer

Increase the online endpoint's minimum replica count and attach larger GPUs so the per-request embedding computation completes faster.

Answer

Enable dynamic request batching on the online endpoint so multiple user requests share the product-embedding computation.

Answer

Apply post-training int8 quantization to the embedding model so each per-request embedding computation runs faster on the same hardware.

Question 7

A retail analytics team needs to score 400 million customer records once per week using a trained TensorFlow model deployed on Vertex AI. The records live in a large BigQuery table. Latency is not a concern, but the team wants the job to complete as quickly and cheaply as possible while avoiding the operational overhead of managing infrastructure. Which approach best meets these requirements?

Accepted Answer

Run a Vertex AI batch prediction job that reads directly from the BigQuery table as the input source and writes results back to BigQuery, letting the service distribute the workload.

Answer

Deploy the model to a Vertex AI online endpoint with autoscaling and send the 400 million records as individual prediction requests from a Dataflow job.

Answer

Export the BigQuery table to a single large CSV file in Cloud Storage and run a batch prediction job pointed at that file.

Answer

Provision a large GPU-backed Compute Engine VM, load the model, and iterate through the records with a custom Python loop.

Question 8

A retail analytics team needs to score their entire customer base (about 40 million records) once every night to generate propensity scores for a next-day marketing campaign. The scores are consumed by a downstream BigQuery table the following morning, so end-to-end latency of a few hours is acceptable. The team currently keeps a Vertex AI online endpoint with multiple GPU replicas running 24/7 to handle this workload, but finance has flagged the cost as excessive. What is the most appropriate change to reduce cost while meeting requirements?

Accepted Answer

Switch to a Vertex AI batch prediction job that reads from BigQuery, runs on demand each night, and provisions compute only for the duration of the job.

Answer

Keep the online endpoint but reduce it to a single CPU replica and disable autoscaling to lower hourly cost.

Answer

Keep the online endpoint but enable dynamic request batching to increase throughput per replica.

Answer

Deploy the model to a private endpoint inside the VPC to reduce network egress charges during scoring.

Question 9

Your team maintains a fraud-scoring model deployed on a Vertex AI online endpoint. A new business requirement asks you to re-score the entire historical transaction table (2 billion rows) once, to backfill risk labels for an analytics dashboard. There is no latency requirement for this one-time job, but you want to minimize cost and total wall-clock time. The online endpoint currently autoscales between 3 and 10 GPU replicas. What is the most appropriate approach?

Accepted Answer

Run a Vertex AI batch prediction job that reads the table from BigQuery, using a high machine count to parallelize the workload.

Answer

Send the 2 billion rows to the existing online endpoint by fanning out many concurrent HTTP requests and temporarily raising max replicas to 50.

Answer

Deploy a second online endpoint dedicated to the backfill and stream all rows through it with dynamic batching enabled.

Answer

Export the online endpoint model and run inference locally in a single notebook loop over all 2 billion rows.

Question 10

Your team trains an image classification CNN on a single NVIDIA A100 GPU using a per-device batch size of 64 and a base learning rate that converges well. To reduce wall-clock time, you scale to 8 A100 GPUs on one node using data-parallel synchronous training with tf.distribute.MirroredStrategy, keeping the same per-device batch size of 64. After the change, training loss decreases much more slowly per epoch and final accuracy drops compared to the single-GPU run. What is the most appropriate first adjustment?

Accepted Answer

Increase the learning rate to account for the larger effective (global) batch size, for example by applying linear scaling relative to the batch-size increase.

Answer

Reduce the per-device batch size to 8 so the global batch size matches the original single-GPU batch size of 64.

Answer

Switch from MirroredStrategy to MultiWorkerMirroredStrategy to improve gradient synchronization across the GPUs.

Answer

Disable synchronous training and use asynchronous parameter-server updates to speed up convergence.

Question 11

A data science team prototypes models in a Vertex AI Workbench notebook using a 50 GB sample pulled into a Pandas DataFrame. The full training dataset lives in BigQuery and is roughly 8 TB, requiring complex windowed aggregations and joins across several tables. The team wants a preprocessing approach that scales to the full dataset for production training runs, minimizes custom infrastructure management, and produces feature tables that both training and future batch jobs can reuse. Which approach should they adopt?

Accepted Answer

Perform the set-based aggregations and joins directly in BigQuery using SQL, materializing the results into curated feature tables that downstream jobs query.

Answer

Increase the notebook machine to a high-memory instance and continue running the transformations with Pandas on the full 8 TB dataset.

Answer

Export the BigQuery tables to CSV files in Cloud Storage and process them with a manually configured Dataproc cluster running Spark.

Answer

Load the full dataset into the notebook in chunks and loop over each chunk with scikit-learn preprocessing transformers.

Question 12

Two data science teams share a Vertex AI Workbench environment to prototype churn models against a large BigQuery table. During prototyping, one team discovers that a colleague's earlier notebook produced a model with 4% higher AUC, but nobody can reproduce it because the underlying training data was overwritten by a nightly ETL job and the feature engineering code was iterated in place. Leadership asks you to establish a practice so future prototype results can be reliably reproduced and compared across teams. Which approach best addresses both data and model reproducibility?

Accepted Answer

Snapshot each training dataset as a BigQuery table with a timestamp suffix, log each run to Vertex AI Experiments capturing parameters and metrics, and register resulting models in Vertex AI Model Registry with links to the dataset snapshot.

Answer

Have each team export their notebook to a shared Cloud Storage bucket after every run and rely on the notebook cell outputs to document metrics and data used.

Answer

Enable BigQuery table expiration on the ETL output tables so historical data is retained longer, and email AUC results to the group after each experiment.

Answer

Increase the Workbench instance disk size so all intermediate CSV files are stored locally, and use Git commit messages to record which model achieved the best AUC.

Question 13

A data science team prototypes models in Vertex AI Workbench notebooks. Their preprocessing code uses pandas to read and transform a 400 GB BigQuery table, but the notebook kernel repeatedly crashes with out-of-memory errors. The team wants to keep writing familiar pandas-style code in the notebook while pushing the heavy computation down to BigQuery so the data never has to fit in the notebook's memory. What should they do?

Accepted Answer

Use the BigQuery DataFrames (bigframes) library, which exposes a pandas-compatible API but executes operations as BigQuery SQL on the server side.

Answer

Increase the Workbench instance to the largest available machine type with more RAM and continue using pandas with the BigQuery client.

Answer

Export the BigQuery table to CSV files in Cloud Storage and read them into pandas in chunks with the chunksize parameter.

Answer

Load the table into a Vertex AI Feature Store and read features into a pandas DataFrame for preprocessing.

Question 14

A data science team at a logistics company needs to explore three years of shipment event logs stored as newline-delimited JSON files in a Cloud Storage bucket (roughly 40 TB, organized in Hive-style date directories like /year=2023/month=05/). Analysts want to run ad hoc exploratory SQL in BigQuery to profile the data before committing to any modeling approach, but leadership is worried about query costs and does not want to duplicate the raw data into BigQuery-managed storage yet. Which approach best supports low-cost, iterative exploration?

Accepted Answer

Create a BigQuery external table over the Cloud Storage files with Hive partitioning enabled, and have analysts filter on the partition columns in their exploratory queries.

Answer

Load all 40 TB into a native BigQuery table with ingestion-time partitioning so analysts can query without touching Cloud Storage.

Answer

Create a non-partitioned external table over the JSON files and instruct analysts to add LIMIT clauses to reduce the amount of data scanned.

Answer

Use a Dataflow pipeline to convert the JSON to Parquet in Cloud Storage first, then query each file individually through the BigQuery Storage Read API.

Question 15

A retail analytics team stores all their customer transaction data in BigQuery. They want to build a churn prediction model directly in BigQuery ML using a boosted tree classifier, and they want BigQuery ML to automatically search for the best combination of learning rate and max tree depth rather than manually experimenting. They also need the final model to be usable for online predictions from a Vertex AI endpoint later. Which approach best meets these requirements with the least custom code?

Accepted Answer

Create a BOOSTED_TREE_CLASSIFIER model in BigQuery ML with NUM_TRIALS and HPARAM_RANGE/HPARAM_CANDIDATES options to enable hyperparameter tuning, then export the model and register it to Vertex AI for online serving.

Answer

Train a custom XGBoost model in a Vertex AI custom training job, manually tune hyperparameters with Vertex AI Vizier, then deploy to an endpoint.

Answer

Use AutoML Tables in Vertex AI, which handles hyperparameter tuning automatically, and skip BigQuery ML entirely.

Answer

Create a LOGISTIC_REG model in BigQuery ML with L1_REG and L2_REG regularization options, since boosted trees do not support hyperparameter tuning in BigQuery ML.

Question 16

A retail analytics team stores three years of daily sales transactions in BigQuery. They need to produce a 30-day demand forecast for each of 5,000 products, including confidence intervals, while keeping the data in place and minimizing custom code or infrastructure management. Which approach best meets these requirements?

Accepted Answer

Create a BigQuery ML ARIMA_PLUS model with a time-series column, item identifier, and TIME_SERIES_ID_COL to train per-product models, then use ML.FORECAST to generate predictions with prediction intervals.

Answer

Export the sales data to Cloud Storage, train a custom LSTM model on Vertex AI with a TensorFlow container, and deploy it to an endpoint for batch forecasting.

Answer

Use a BigQuery ML LINEAR_REG model with the date as a numeric feature and call ML.PREDICT to estimate future sales for each product.

Answer

Send each product's historical sales to the Vertex AI Gemini API and prompt the model to predict the next 30 days of demand.

Question 17

A retail analytics team has a BigQuery table with millions of rows of customer transaction data, including recency, frequency, and monetary value features. The marketing department wants to group customers into an unspecified number of natural segments for targeted campaigns, but there are no pre-existing labels indicating which segment each customer belongs to. The team wants a fully SQL-based, low-code approach without exporting data. Which BigQuery ML approach should they use?

Accepted Answer

Create a k-means model using CREATE MODEL with MODEL_TYPE='KMEANS' and evaluate cluster quality with the Davies-Bouldin index

Answer

Create a logistic regression model using MODEL_TYPE='LOGISTIC_REG' to predict each customer's segment label

Answer

Create a multiclass classification model using MODEL_TYPE='DNN_CLASSIFIER' on the transaction features

Answer

Create an ARIMA_PLUS time-series model to forecast future customer purchasing behavior

Question 18

A retail analytics team has trained a logistic regression model in BigQuery ML to predict which customers will churn. Business stakeholders want to understand, for each individual prediction, which features pushed the customer toward or away from churning so they can design targeted retention offers. The team wants to stay entirely within BigQuery using SQL and avoid exporting the model. Which approach should they use?

Accepted Answer

Run ML.EXPLAIN_PREDICT on the model to obtain per-prediction feature attributions alongside the predicted labels

Answer

Run ML.GLOBAL_EXPLAIN after enabling global explanations during training to see per-customer feature contributions

Answer

Run ML.EVALUATE to produce a confusion matrix and precision/recall values for each customer

Answer

Export the model to Vertex AI and enable Vertex Explainable AI with sampled Shapley to get per-row attributions

Question 19

A SaaS company stores millions of historical customer support tickets in BigQuery, each labeled with one of five routing categories (Billing, Technical, Account, Sales, Other). The data engineering team wants to automatically predict the routing category for new tickets using the text description column, and they prefer to build and serve the model without moving data out of BigQuery or writing custom training code. Which approach best meets these requirements?

Accepted Answer

Use BigQuery ML to train a model with MODEL_TYPE='LOGISTIC_REG' on the label column, letting BigQuery ML automatically detect the multiclass target and generate text feature transformations.

Answer

Create a BigQuery ML logistic regression model with MODEL_TYPE='LOGISTIC_REG', which natively handles the five-category target and text features.

Answer

Export the tickets to Cloud Storage and train a custom PyTorch text classifier on Vertex AI, then deploy it to an online endpoint.

Answer

Call the Cloud Natural Language API's classifyText method on each ticket to obtain the routing category directly.

Question 20

A retail analytics team stores millions of transaction records in BigQuery. A data scientist has already trained and deployed a custom fraud-scoring model to a Vertex AI online endpoint. The business analysts, who only know SQL, need to run predictions against this deployed model directly from their BigQuery queries without exporting data or writing Python. Which approach best meets this requirement with the least operational overhead?

Accepted Answer

Create a BigQuery ML remote model referencing the Vertex AI endpoint, then call ML.PREDICT on it from SQL.

Answer

Export the BigQuery table to Cloud Storage and run a Vertex AI batch prediction job against the endpoint.

Answer

Re-train the fraud model entirely inside BigQuery ML using CREATE MODEL so the analysts can use ML.PREDICT.

Answer

Have the analysts call the Vertex AI endpoint through a Cloud Function that they invoke via HTTP for each row.

Question 21

A retail analytics team stores millions of customer feedback comments in a BigQuery table. Analysts who know SQL but have no ML or Python experience want to classify each comment into one of five predefined product-category themes and generate a one-sentence summary, running the process entirely within their existing BigQuery workflows. They want the fastest path to production without training a custom model or standing up separate inference infrastructure. What should they do?

Accepted Answer

Create a BigQuery ML remote model that references a Vertex AI Gemini endpoint, then call ML.GENERATE_TEXT with a prompt column that instructs the model to classify and summarize each comment.

Answer

Export the comments to Cloud Storage, train an AutoML text classification model in Vertex AI, deploy it to an online endpoint, and call it from a scheduled query.

Answer

Use CREATE MODEL with model_type='logistic_reg' in BigQuery ML to train a multiclass classifier directly on the raw comment text.

Answer

Build a Vertex AI Pipeline that reads from BigQuery, fine-tunes a foundation model on the comments, and writes predictions back to a results table.

Question 22

A retail analytics team stores millions of product reviews in a BigQuery table. Analysts who are comfortable with SQL but not with Python want to generate concise one-sentence summaries of each review directly inside their existing BigQuery workflow, without building a custom pipeline or managing serving infrastructure. Which approach best meets these requirements with the least operational overhead?

Accepted Answer

Create a BigQuery ML remote model that references a Vertex AI Gemini endpoint, then call ML.GENERATE_TEXT in a SQL query over the reviews table.

Answer

Export the reviews to Cloud Storage, run a Vertex AI batch prediction job against a Gemini model, and load the summaries back into BigQuery.

Answer

Train a custom text summarization model with AutoML and deploy it to a Vertex AI online endpoint that analysts query via the REST API.

Answer

Build a Dataflow streaming pipeline that reads from BigQuery, calls the Vertex AI SDK for each row, and writes summaries to a new table.

Question 23

A data analytics team wants to run entity sentiment analysis on millions of product reviews stored in a BigQuery table. They prefer to stay entirely within SQL and avoid writing any Python or exporting data. They plan to use the Cloud Natural Language API via BigQuery ML. When creating the remote model with CREATE MODEL ... REMOTE WITH CONNECTION, what is the essential configuration step required so that BigQuery can successfully invoke the Cloud Natural Language API?

Accepted Answer

Grant the BigQuery connection's service account the appropriate IAM role (e.g., Cloud Natural Language API user/service usage) and enable the Cloud Natural Language API in the project

Answer

Export the reviews to Cloud Storage first, because BigQuery ML remote models can only read input from GCS buckets

Answer

Deploy the Natural Language model to a Vertex AI endpoint and reference that endpoint URL in the ENDPOINT option of the remote model

Answer

Create a service account key file and embed the JSON credentials directly in the SQL CREATE MODEL statement

Question 24

A data analytics team stores millions of customer review texts in a BigQuery table. They want to build a semantic search feature that finds reviews similar to a given query, and they prefer to stay entirely within SQL workflows without exporting data or writing Python pipelines. They need to generate text embeddings at scale directly in BigQuery. What is the most appropriate low-code approach?

Accepted Answer

Create a BigQuery ML remote model that references a Vertex AI text embedding foundation model, then call ML.GENERATE_EMBEDDING on the reviews table.

Answer

Train an AutoML text classification model in Vertex AI and use its prediction scores as embedding vectors for similarity search.

Answer

Export the reviews to Cloud Storage and call the Natural Language API's entity analysis to compute similarity between documents.

Answer

Use CREATE MODEL with a BigQuery ML matrix factorization model to produce embeddings from the review text columns.

Question 25

A retail analytics team stores 4 million product photos in Cloud Storage, with their metadata (GCS URIs, SKU, category) already loaded into a BigQuery object table. Analysts who are fluent in SQL but have no ML training pipeline experience need to generate descriptive labels for each image to enrich the product catalog. They want the lowest-effort approach that keeps everything within their existing BigQuery workflow and does not require them to build or manage any serving infrastructure. What should they do?

Accepted Answer

Create a BigQuery ML remote model that connects to the Cloud Vision API and call ML.ANNOTATE_IMAGE over the object table to generate labels directly in SQL.

Answer

Train an AutoML image classification model in Vertex AI, deploy it to an online endpoint, and have analysts write SQL that calls the endpoint per row.

Answer

Export all images to a Vertex AI managed dataset, run a custom TensorFlow training job to build a labeler, then batch predict and load results back to BigQuery.

Answer

Write a Dataflow pipeline that reads the object table, calls the Vision API for each image, and streams annotations into a BigQuery results table.

Question 26

A retail analytics team has an existing TensorFlow SavedModel that predicts product return likelihood. The model was trained outside Google Cloud by a data science partner. The team wants their SQL-focused analysts to run batch predictions on customer transaction data that already lives in BigQuery, without exporting the data or standing up a separate serving infrastructure. What is the most appropriate low-code approach?

Accepted Answer

Use CREATE MODEL with the MODEL_TYPE='TENSORFLOW' option and MODEL_PATH pointing to the SavedModel in Cloud Storage, then run ML.PREDICT against the BigQuery table

Answer

Deploy the SavedModel to a Vertex AI endpoint and have analysts call the endpoint from a Cloud Function for each transaction row

Answer

Retrain the model from scratch as a BigQuery ML boosted tree classifier since imported TensorFlow models cannot be used for prediction in BigQuery

Answer

Export the BigQuery table to Cloud Storage as CSV and run the TensorFlow model locally with a Python batch script

Question 27

Your team trains a large PyTorch image model on Vertex AI custom training. Each run takes about 30 hours on a single node with multiple GPUs. To reduce cost, you switched to Spot (preemptible) VMs, but you notice that when a VM is reclaimed, the job restarts from scratch and wastes many GPU-hours. You must keep costs low while ensuring interrupted runs can resume efficiently. What should you do?

Accepted Answer

Periodically save model and optimizer state to Cloud Storage and configure the training job to resume from the latest checkpoint on restart, keeping Spot VMs and enabling automatic retries.

Answer

Switch back to standard (on-demand) VMs and remove checkpointing since the job will no longer be interrupted.

Answer

Reduce the number of training epochs so that each run completes before a Spot VM is likely to be preempted.

Answer

Move the training to a smaller CPU-only machine so that preemption happens less frequently and restarts are cheaper.

Question 28

You operate a deployed churn-prediction model on Vertex AI. Your monitoring shows that the statistical distribution of the incoming feature values has remained stable over the past three months (no input feature skew or drift detected). However, business stakeholders report that the model's live accuracy, measured against ground-truth churn labels that arrive 30 days later, has steadily declined from 0.88 to 0.71. What is the most likely cause of this degradation?

Accepted Answer

Concept drift — the relationship between the input features and the target label has changed even though input distributions are unchanged

Answer

Training-serving skew caused by inconsistent preprocessing between the training pipeline and the serving endpoint

Answer

Prediction drift caused by a shift in the distribution of the model's output scores

Answer

Data drift caused by a change in the input feature distributions over time

Question 29

Your team is training a large image classification CNN on a single NVIDIA A100 GPU using TensorFlow. To fit a larger batch size and speed up training, you enabled mixed-precision (float16) training. After the change, throughput improved significantly, but the loss frequently becomes NaN early in training and the model fails to converge. What is the most appropriate action to fix the instability while keeping the performance benefits of mixed precision?

Accepted Answer

Apply dynamic loss scaling so small gradients are not lost to float16 underflow while keeping numerically sensitive operations in float32.

Answer

Revert entirely to float32 training since mixed precision is inherently unstable on A100 GPUs.

Answer

Reduce the learning rate to near zero to prevent the loss from ever spiking to NaN.

Answer

Switch the hardware to a TPU v3 pod, which does not experience float16 numerical issues.

Question 30

Your team has prototyped a gradient-boosted decision tree model (XGBoost) on a small tabular dataset for predicting equipment maintenance needs. You now need to scale training to a 200 GB dataset and later serve batch predictions nightly. A junior engineer suggests provisioning a cluster of GPU-accelerated VMs for both training and inference to maximize speed. What is the most cost-effective and appropriate hardware recommendation for this workload?

Accepted Answer

Use high-memory CPU machines for both distributed training and batch inference, since tree-based models like XGBoost are largely CPU-bound and gain little from GPU acceleration relative to cost.

Answer

Use TPUs for training and GPUs for batch inference, because TPUs offer the best price-performance for all tabular model types.

Answer

Use a large fleet of GPU VMs for training and inference to match the engineer's recommendation, as GPUs accelerate all matrix operations regardless of model architecture.

Answer

Use TPU Pods for training because the 200 GB dataset requires the parallelism only TPUs provide, then serve inference on CPUs.

Question 31

Your team deployed a credit-approval model on Vertex AI. Regulators require ongoing evidence that the model does not produce discriminatory outcomes across protected groups such as gender and ethnicity. The model shows strong overall accuracy, but leadership is concerned about fairness in production. Which approach best addresses this responsible-AI risk during ongoing monitoring?

Accepted Answer

Continuously monitor approval rates and error rates disaggregated by protected group using fairness metrics such as demographic parity difference and equal opportunity difference, and alert when disparities exceed defined thresholds.

Answer

Rely on the model's overall accuracy and AUC in production, since a high-performing model is inherently fair across all subgroups.

Answer

Remove the protected attributes from the training features so the model cannot use them, which guarantees the outcomes are unbiased.

Answer

Enable feature-attribution drift monitoring on the input features and treat any drift alert as evidence of a fairness violation.

Question 32

A data science team at a biotech firm has a labeled dataset of only 1,800 records for a tabular classification task predicting patient treatment response. They are prototyping several model architectures and want a reliable estimate of generalization performance before committing to a full training and hyperparameter tuning run on Vertex AI. A single hold-out validation split gave them wildly different accuracy numbers each time they reshuffled the data. What is the most appropriate approach to obtain a robust performance estimate given the dataset size?

Accepted Answer

Use k-fold cross-validation (e.g., 5- or 10-fold) to average performance across multiple train/validation partitions.

Answer

Increase the size of the single hold-out validation set to 50% of the data to reduce variance in the estimate.

Answer

Train on all 1,800 records and report training accuracy as the generalization estimate.

Answer

Collect a larger dataset before doing any modeling, since 1,800 records cannot yield meaningful estimates.

Question 33

Your team is training a 40-billion-parameter transformer language model from scratch. Each model replica's parameters, optimizer states, and activations far exceed the 40 GB of memory available on a single GPU, so the full model cannot fit on one device. You have access to a multi-node cluster of GPUs on Vertex AI custom training. Which distributed training approach should you adopt to make training feasible?

Accepted Answer

Model/tensor parallelism (e.g., sharding layers and parameters across GPUs), optionally combined with data parallelism, so a single model instance spans multiple devices

Answer

Standard synchronous data parallelism, replicating the full model on each GPU and averaging gradients across replicas

Answer

Reduce the global batch size to 1 and use gradient accumulation so the model fits on a single GPU

Answer

Asynchronous parameter-server training with each worker holding a full model copy and pushing updates independently

Question 34

Your ML team needs to preprocess 8 TB of raw clickstream logs stored in Cloud Storage before training. The pipeline must join the logs against a 200 GB user-profile table in BigQuery, apply session-based windowing, and write cleaned features back to BigQuery for downstream training. Multiple teams will reuse this pipeline on a scheduled daily basis. Which approach best satisfies scalability, reusability, and maintainability requirements?

Accepted Answer

Build an Apache Beam pipeline on Dataflow that reads logs from Cloud Storage, joins with the BigQuery user-profile data as a side input or via a BigQuery source, applies session windows, and writes to BigQuery, deployed as a reusable Flex Template.

Answer

Load all data into a single BigQuery table and perform the joins and windowing with a scheduled SQL query, exporting results to a CSV in Cloud Storage.

Answer

Write a Python script in a Vertex AI notebook using pandas to load the logs and profiles into memory, perform the joins, and upload the results to BigQuery.

Answer

Use a Dataproc Spark job triggered manually each day, storing intermediate results in HDFS and copying the final output to BigQuery.

Question 35

Your team runs a nightly Dataflow batch pipeline that reads raw event logs from Cloud Storage, applies transformations, and writes the results to a BigQuery table used by three other teams for feature exploration. Recently, downstream data scientists complain that record counts vary between runs even when the input files are identical, and they see duplicate rows after failed-and-retried jobs. You need to guarantee that repeated pipeline runs produce a consistent, deduplicated table without manual cleanup. What should you do?

Accepted Answer

Configure the BigQueryIO write with WRITE_TRUNCATE disposition and a deterministic key so each run replaces the table contents idempotently.

Answer

Switch the pipeline to streaming mode and rely on Pub/Sub exactly-once delivery to prevent duplicates.

Answer

Increase the number of Dataflow workers so the job finishes faster and is less likely to be retried.

Answer

Add a post-processing scheduled query in BigQuery that runs SELECT DISTINCT into a new table each morning.

Question 36

Your data engineering and ML teams share a clickstream pipeline. Raw events arrive continuously on a Pub/Sub topic and must be cleaned, windowed into 5-minute session aggregates, and written to BigQuery so both teams can build features from the same processed data. The processing logic includes stateful sessionization and must handle late-arriving events with watermarks. Which approach best meets these requirements?

Accepted Answer

Build an Apache Beam streaming pipeline on Dataflow that reads from Pub/Sub, applies session windows with allowed lateness, and streams results to BigQuery.

Answer

Schedule an hourly BigQuery scheduled query that pulls raw events from an external Pub/Sub table and aggregates them into sessions.

Answer

Use a Cloud Function triggered per Pub/Sub message to compute session aggregates and insert rows into BigQuery.

Answer

Export Pub/Sub messages to Cloud Storage in batches and run a nightly Dataproc Spark batch job to compute session windows.

Question 37

A retail ML team preprocesses large volumes of transaction data for a churn model. During exploration in a Vertex AI Workbench notebook, engineers apply normalization and vocabulary-based categorical encoding using pandas. When the model is deployed, the online serving pipeline must apply the exact same transformations, but the team discovers subtle differences between training and serving preprocessing that degrade predictions. They want a scalable, reproducible approach that guarantees identical transformation logic in both batch training preprocessing and online serving. Which approach should they adopt?

Accepted Answer

Use TensorFlow Transform (tf.Transform) with Dataflow to compute preprocessing statistics over the full dataset and export a transform graph that is embedded into the serving signature.

Answer

Rewrite the pandas preprocessing as a Cloud Function that both the training job and the serving endpoint call over HTTP before inference.

Answer

Save the pandas preprocessing code in a shared Git repository and require both the training and serving teams to import the same module.

Answer

Precompute all transformed features in BigQuery and store both training and serving features in Vertex AI Feature Store without embedding transformations in the model.

Question 38

You are an ML engineer joining a large enterprise with hundreds of BigQuery datasets spread across multiple projects owned by different business units. Before prototyping a churn model, you need to discover which existing tables contain customer transaction data, understand their schemas, check data quality metrics, and confirm you have appropriate access—without manually contacting each team. Which Google Cloud approach best enables this organization-wide data exploration and governance?

Accepted Answer

Use Dataplex to organize the datasets into lakes and zones, and use its integrated Data Catalog to search metadata, view schemas, and inspect data profiling and quality scans across projects.

Answer

Export every BigQuery table's schema to a shared Google Sheet and manually annotate which tables contain customer data for the team to reference.

Answer

Grant yourself BigQuery Admin on all projects, then run SELECT * queries against each table to inspect the data and infer its contents.

Answer

Provision a Vertex AI Feature Store and ingest all candidate tables so you can browse feature metadata in one place before modeling.

Question 39

A data science team wants to explore several terabytes of raw event logs stored in Cloud Storage as Parquet files. They need to run ad hoc PySpark transformations and profiling from within their Vertex AI Workbench notebooks, but they do not want to provision or manage a persistent Spark cluster and want to minimize idle costs between exploration sessions. Which approach best meets these requirements?

Accepted Answer

Use Dataproc Serverless for Spark interactive sessions from the Vertex AI Workbench notebook to run PySpark against the Parquet data on demand.

Answer

Create a long-running Dataproc cluster with autoscaling enabled and attach it to the notebook via the Dataproc JupyterLab plugin.

Answer

Load the entire dataset into a pandas DataFrame in the notebook and process it with local Spark in standalone mode.

Answer

Export the Parquet files into BigQuery and run all exploration exclusively with BigQuery SQL, avoiding Spark entirely.

Question 40

Your team is training a model on a dataset of hospital patient records to predict readmission risk. Legal and compliance flag that the model must not allow attackers to infer whether a specific individual's record was part of the training set, even if the attacker has access to the model and some auxiliary data. Model accuracy is important but secondary to this privacy guarantee. Which approach best mitigates this specific privacy risk?

Accepted Answer

Apply differential privacy during training (e.g., DP-SGD) to bound the influence any single training example has on the model.

Answer

Encrypt the training dataset at rest and in transit using customer-managed encryption keys (CMEK).

Answer

Remove all direct identifiers such as name and patient ID from the dataset before training.

Answer

Restrict access to the deployed endpoint using IAM and a private VPC endpoint.

Question 41

A retail company runs a 340M-parameter BERT-based text classifier on a Vertex AI endpoint to categorize incoming customer chat messages in real time. The model meets accuracy targets, but p99 latency is 480 ms — well above the 120 ms SLA — and GPU serving costs are high. The team wants to dramatically reduce latency and cost while keeping accuracy within about 2% of the current model, and they are willing to invest in a one-time offline effort. Which approach best meets these requirements?

Accepted Answer

Apply knowledge distillation to train a much smaller student model using the current model as the teacher, then serve the student model.

Answer

Switch the endpoint from online inference to batch inference to process messages more efficiently.

Answer

Increase the minimum replica count and add more GPUs to the endpoint's autoscaling configuration.

Answer

Enable request-response logging and raise the endpoint's maximum concurrent request limit.

Question 42

Your team serves a large BERT-based text classifier on a Vertex AI endpoint with GPU accelerators. Traffic has grown, and GPU serving costs are becoming unsustainable. The business requires that classification accuracy remain within 1% of the current model, and that p95 latency stay under 50 ms. You want to reduce serving cost the most while meeting both constraints, and you have access to the full labeled training dataset plus abundant unlabeled production text. Which optimization approach should you pursue first?

Accepted Answer

Train a much smaller student model via knowledge distillation using the large model as the teacher, then evaluate it against the accuracy and latency constraints on CPU serving.

Answer

Apply post-training int8 quantization to the existing large model and deploy it unchanged on the same GPU endpoint.

Answer

Increase the endpoint's minimum replica count and lower the autoscaling GPU utilization target to spread traffic across more nodes.

Answer

Switch the endpoint from GPU to a larger-memory GPU type to process more requests per replica.

Question 43

Your team has a TensorFlow model that trains on a 4 TB dataset stored in Cloud Storage as TFRecord files. A single-node 8-GPU machine takes over 40 hours per training run, which is blocking your experimentation velocity. The model uses large embedding layers and dense transformer blocks, and the training loop is written with the Keras API. You need to dramatically reduce wall-clock training time while keeping code changes minimal and controlling cost. What is the most appropriate approach?

Accepted Answer

Refactor the training code to use tf.distribute.TPUStrategy and run on a Cloud TPU v-series Pod slice, using tf.data to stream the TFRecords from Cloud Storage.

Answer

Keep the single-node setup but switch the machine type to one with more vCPUs and add more Cloud Storage read parallelism to speed up data loading.

Answer

Migrate the workload to BigQuery ML so the training runs directly where a copy of the data can be loaded, avoiding GPU costs entirely.

Answer

Convert the model to scikit-learn and use joblib parallel backends across multiple CPU nodes to distribute the training.

Question 44

Your team has a TensorFlow 2 image classification model that currently trains on a single GPU and takes 18 hours per run. You provisioned a Vertex AI custom training job on one machine equipped with 4 NVIDIA A100 GPUs and want to reduce training time with minimal code changes while keeping the model architecture unchanged. Which approach should you use to distribute training across the 4 GPUs?

Accepted Answer

Wrap the model construction and compilation inside tf.distribute.MirroredStrategy scope and let it synchronize gradients across the 4 GPUs

Answer

Use tf.distribute.MultiWorkerMirroredStrategy and configure a TF_CONFIG environment variable listing the 4 GPUs as separate workers

Answer

Use tf.distribute.ParameterServerStrategy with one GPU acting as the parameter server and the remaining three as workers

Answer

Manually split each training batch into four shards and run four independent training processes, then average the resulting model weights after each epoch

Question 45

A healthcare analytics company needs to extract structured data (patient ID, test names, numeric result values, and reference ranges) from thousands of scanned lab reports that come from dozens of different labs, each using its own unique layout. The pre-trained Document AI processors do not recognize these domain-specific fields, and the layouts vary too widely for a template-based rules approach. The team wants the lowest-code path to a production extraction pipeline. What should they do?

Accepted Answer

Use the Document AI Custom Extractor processor, label a set of representative lab reports with the target fields, and train the processor to extract them.

Answer

Use the Document AI Form Parser processor, which automatically extracts all key-value pairs from any document layout without training.

Answer

Use the Document OCR processor to extract raw text, then write custom regular expressions to locate each field in the output.

Answer

Fine-tune a Gemini model in Model Garden on the scanned images to output the structured fields as JSON.

Question 46

A healthcare clinic receives thousands of scanned patient intake forms each day. The forms use a consistent template with labeled fields (name, date of birth, insurance ID) but often contain handwritten patient entries. The team wants a low-code solution that extracts the field-value pairs into structured key-value data without building or training a custom model, and needs it to handle the handwriting reliably. Which Google Cloud approach should they choose?

Accepted Answer

Use the Document AI Form Parser processor, which extracts key-value pairs and includes handwriting recognition out of the box.

Answer

Use the Vision API DOCUMENT_TEXT_DETECTION feature and write custom logic to associate text blocks into field-value pairs.

Answer

Train a Document AI Custom Extractor processor with hundreds of labeled documents to recognize each field.

Answer

Use the Vision API TEXT_DETECTION feature to return dense text, then apply a regex pipeline to reconstruct the form fields.

Question 47

A logistics company receives thousands of supplier invoices daily as scanned PDFs with varying layouts. The finance team wants to automatically extract structured fields such as invoice number, vendor name, line items, and total amount to feed into their accounts payable system, with minimal custom ML development. Which Google Cloud approach best meets this requirement?

Accepted Answer

Use the Document AI Invoice Parser processor to extract the structured entities from the PDFs

Answer

Use the Cloud Vision API's text detection (OCR) feature and write regular expressions to parse the extracted text

Answer

Train a custom AutoML Vision image classification model to categorize the invoice images

Answer

Load the raw PDF bytes into BigQuery and use BigQuery ML to run a logistic regression on the documents

Question 48

A financial services company receives thousands of lengthy quarterly earnings PDF reports each week. Analysts need a low-code solution that first extracts the full text (including tables) from these PDFs, then produces a concise natural-language summary of each report's key financial highlights. The team has minimal ML expertise and wants to minimize custom code and infrastructure management. Which combination of Google Cloud services best meets these requirements?

Accepted Answer

Use the Document AI OCR/Document processor to extract text, then send the extracted text to a Gemini model from Model Garden (Vertex AI) to generate summaries.

Answer

Train a custom AutoML text classification model on the PDFs, then use the Cloud Natural Language API to generate summaries.

Answer

Import each PDF into a BigQuery ML remote model and run a SELECT query with ML.GENERATE_TEXT directly against the raw PDF bytes.

Answer

Use the Cloud Vision API to detect text in the PDFs, then build a custom TensorFlow seq2seq summarization model deployed on Vertex AI endpoints.

Question 49

You run a TensorFlow image-classification model on a Vertex AI online endpoint backed by GPUs. Traffic is bursty, and during peak periods GPU utilization stays low (around 30%) even though request latency climbs and clients report timeouts. Each individual request contains a single image. You want to increase throughput and improve GPU efficiency without reducing model accuracy or provisioning more replicas. What is the most effective change?

Accepted Answer

Enable server-side request (dynamic) batching so multiple concurrent single-image requests are grouped into one batch before the GPU forward pass.

Answer

Switch the endpoint from GPU to CPU machines to eliminate the GPU scheduling overhead causing the low utilization.

Answer

Convert the deployment to a batch prediction job that reads requests from Cloud Storage and writes results back.

Answer

Increase the autoscaling maximum replica count and lower the target GPU utilization threshold to 20%.

Question 50

A SaaS company receives customer support tickets in over 15 languages. The product team wants a low-code solution to automatically extract mentioned product names, organizations, and locations from incoming ticket text so tickets can be routed to the right regional team. They have no labeled training data and want to ship quickly using a managed Google Cloud service. Which approach best fits these requirements?

Accepted Answer

Use the Cloud Natural Language API entity analysis feature to extract entities directly from the ticket text without training a custom model.

Answer

Train an AutoML text entity extraction model in Vertex AI using the historical tickets after manually labeling a representative sample.

Answer

Fine-tune a Gemini model in Model Garden on the multilingual ticket corpus to perform named entity recognition.

Answer

Use Document AI's Form Parser to extract entity fields from the ticket text across all supported languages.

Question 51

You deployed a gradient-boosted model on a Vertex AI endpoint to predict loan default. Overall prediction accuracy and the marginal distributions of each input feature (monitored via training-serving skew and drift detection) have stayed within alert thresholds for three months. However, business stakeholders report that recent predictions no longer match domain intuition, and a manual audit suggests the model is now weighting certain features very differently than at launch. Which monitoring approach would most directly detect this problem?

Accepted Answer

Enable feature attribution drift monitoring so shifts in each feature's contribution to predictions are tracked over time

Answer

Increase the sampling rate of the existing input feature drift monitoring job

Answer

Add prediction output distribution monitoring to detect changes in the score histogram

Answer

Reduce the training-serving skew alert threshold so smaller deviations trigger alerts

Question 52

Three ML teams at your company each maintain their own preprocessing pipelines that compute nearly identical customer-level features (e.g., 30-day purchase frequency, average session length). This leads to duplicated engineering effort, inconsistent definitions, and drifting values across teams. Leadership wants a governed, reusable approach so features are defined once and shared for both training and low-latency online serving. Which approach best addresses this?

Accepted Answer

Centralize the shared features in Vertex AI Feature Store, organizing them into feature groups/entity types that all teams read from for training and online serving.

Answer

Have each team publish its computed features to a shared BigQuery dataset and query it directly at serving time for every prediction request.

Answer

Store the features as CSV exports in a shared Cloud Storage bucket and have each team load the latest file before training.

Answer

Ask each team to copy the best-performing team's preprocessing notebook into their own project and run it independently.

Question 53

A media company deploys a recommendation model that ranks articles for users. The model is retrained weekly using logged user clicks as ground-truth labels. Over several months, the team notices that recommendation diversity collapses—users increasingly see only a narrow set of popular topics, and engagement among niche-interest users declines. Data drift and skew monitoring show no anomalies in input feature distributions. What is the most likely root cause of this degradation?

Accepted Answer

A feedback loop: the model's own recommendations shape the click logs used for retraining, so labels are biased toward previously surfaced items, amplifying popularity bias over successive training cycles.

Answer

Training-serving skew caused by different preprocessing code paths between the training pipeline and the online serving container.

Answer

Concept drift in which the true relationship between features and user preferences has shifted independently of the model's behavior.

Answer

Numerical feature drift that the monitoring thresholds are configured too loosely to detect.

Question 54

Your team has a prototype trained in scikit-learn on a small sample of tabular data. The production dataset has 4 billion rows stored in BigQuery, with several high-cardinality categorical features. You must train a gradient-boosted model that scales to the full dataset, supports distributed training across multiple workers, and integrates cleanly with Vertex AI managed training. Which approach best meets these requirements?

Accepted Answer

Rewrite the model using XGBoost with its distributed (Dask or Spark) backend, run it as a Vertex AI custom training job across multiple workers, and read data in shards from BigQuery.

Answer

Continue with scikit-learn's GradientBoostingClassifier on a single high-memory Vertex AI training VM, loading the data into a pandas DataFrame.

Answer

Export all 4 billion rows to a single CSV in Cloud Storage and train scikit-learn with joblib parallelism on one machine with many vCPUs.

Answer

Convert the tabular data to images and train a convolutional neural network on TPUs for maximum throughput.

Question 55

Your team deployed a resume-screening model to rank candidates for engineering roles. During a responsible AI review, you discover that although gender was explicitly removed from the training data, the model still recommends male candidates at a significantly higher rate. Investigation shows the model relies heavily on features like 'years of continuous employment' and membership in certain college sports clubs, which correlate strongly with gender. What is the MOST appropriate action to address this fairness risk?

Accepted Answer

Identify and mitigate the proxy features driving disparate impact, then evaluate the model against fairness metrics such as demographic parity or equalized odds before redeploying.

Answer

Re-add gender as a feature so the model can be explicitly calibrated to produce equal selection rates across groups.

Answer

Increase the training dataset size so the model learns a more general representation and the correlation disappears naturally.

Answer

Lower the decision threshold uniformly for all candidates to increase the number of people recommended and reduce overall disparity.

Question 56

Your team deployed a generative AI assistant on Vertex AI that answers customer questions by drawing on an internal knowledge base. During a responsible-AI review, security raises a concern: the model occasionally echoes back personally identifiable information (PII) such as email addresses and account numbers that appeared in the prompt or retrieved context. Leadership wants an ongoing safeguard that reduces the risk of PII being surfaced in production responses without retraining the model. Which approach best mitigates this privacy risk?

Accepted Answer

Add a post-processing inspection step that runs each model response through Cloud Data Loss Prevention (DLP) to detect and redact PII before returning it to the user, and log detections for auditing.

Answer

Enable Vertex AI Model Monitoring for feature attribution drift so you can detect when input distributions change over time.

Answer

Increase the model's temperature setting so that responses are more varied and less likely to reproduce exact strings from the context.

Answer

Retrain the model with differential privacy so memorized training examples cannot be reconstructed.

Question 57

Your team hosts 12 lightweight image-classification models on Vertex AI, each receiving low but steady traffic (a few requests per second). Each model fits comfortably in about 2 GB of GPU memory. Currently each model runs on its own dedicated node with a full NVIDIA T4 GPU, and GPU utilization per node hovers around 8%. Leadership wants to cut serving costs without materially increasing latency. What is the most effective way to reduce cost here?

Accepted Answer

Deploy all 12 models to a single Vertex AI endpoint as co-hosted models sharing the same GPU-backed DeployedModel resources, consolidating them onto fewer GPU nodes

Answer

Switch every model to CPU-only nodes and enable dynamic batching to compensate for the loss of GPU acceleration

Answer

Keep one GPU per model but enable autoscaling with a minimum of zero replicas so idle models scale to nothing

Answer

Apply INT8 quantization to each model so they run faster and the GPUs finish requests sooner

Question 58

You are training a large image classification CNN on a single Vertex AI custom training node equipped with one NVIDIA A100 (40 GB) GPU. Training crashes with a CUDA out-of-memory error only after you increased the input image resolution from 224x224 to 512x512. The model architecture and dataset are fixed, and you must keep the higher resolution. You want the simplest change that lets training proceed on the same single-GPU node without significantly degrading final model accuracy. Which action should you take first?

Accepted Answer

Reduce the per-step batch size and use gradient accumulation to maintain the effective batch size

Answer

Switch the training node to a machine with 8 A100 GPUs and enable MirroredStrategy

Answer

Downsample the input images back to 224x224 to fit within GPU memory

Answer

Convert the model to run on a TPU v3 Pod slice to avoid GPU memory limits

Question 59

Your team is training a large vision transformer on a single NVIDIA A100 (40 GB) GPU using PyTorch on Vertex AI. Research shows the model converges best with an effective batch size of 512, but the GPU runs out of memory at a batch size of 64. You must not change hardware and want to preserve the target effective batch size without degrading convergence. What is the most appropriate technique?

Accepted Answer

Enable gradient accumulation over 8 micro-batches of size 64 before applying an optimizer step

Answer

Reduce the batch size to 64 and proportionally lower the learning rate to compensate

Answer

Switch to a MultiWorkerMirroredStrategy across additional GPUs to split the batch

Answer

Cast all model weights to int8 quantization to reduce memory footprint during training

Question 60

You deployed a loan-default prediction model on a Vertex AI endpoint. Actual default outcomes (ground-truth labels) only become known 6 to 12 months after a prediction is made. Business stakeholders want early warning if the model's real-world quality begins to degrade, well before those delayed labels arrive. Which monitoring approach best addresses this constraint?

Accepted Answer

Configure input feature drift and prediction distribution drift monitoring on the endpoint so shifts can be detected immediately, and reserve delayed-label performance evaluation for confirmation once outcomes mature.

Answer

Wait for the 6-to-12-month ground-truth labels to arrive, then compute accuracy and AUC to determine whether the model has degraded.

Answer

Disable monitoring entirely because meaningful performance metrics cannot be produced until labels are available.

Answer

Retrain the model on a fixed weekly schedule regardless of any signals, assuming frequent retraining eliminates the need for monitoring.

Question 61

Your team serves a TensorFlow image-classification model on a Vertex AI endpoint. A high-volume internal microservice sends millions of prediction requests per hour and is experiencing significant per-request serialization overhead and connection setup latency. The payloads are large tensor arrays. You want to reduce serving latency and increase throughput between the client and the model server without changing the model itself. Which change should you prioritize?

Accepted Answer

Switch the client-to-server communication to use the gRPC protocol with a persistent connection and binary protobuf payloads.

Answer

Increase the endpoint's minimum replica count so more machines are always available to handle load.

Answer

Convert all requests to base64-encoded JSON strings sent over the existing REST/HTTP interface.

Answer

Enable request-response logging on the endpoint to capture and analyze payload sizes.

Question 62

Your team deployed a Vertex AI model that predicts patient readmission risk using clinical records containing protected health information (PHI). During a compliance review, auditors ask you to demonstrate that access to model predictions and the underlying request payloads is controlled, traceable, and that PHI is not inadvertently exposed to unauthorized team members through monitoring artifacts. Which approach best addresses this responsible-AI privacy risk?

Accepted Answer

Restrict endpoint and logging-dataset access with IAM least-privilege roles, enable Cloud Audit Logs for data-access events, and de-identify or exclude PHI fields before they are written to prediction logs.

Answer

Enable Vertex AI request-response logging to BigQuery with full payloads, then grant all data scientists BigQuery Viewer so they can debug predictions quickly.

Answer

Disable all prediction logging entirely so no PHI is ever stored, and rely on the model's aggregate accuracy metrics for any future audits.

Answer

Encrypt the model artifact with a customer-managed encryption key (CMEK) and consider the privacy requirement fully satisfied since the data is encrypted at rest.

Question 63

A healthcare startup deploys a Vertex AI model that classifies dermatology images as benign or requiring specialist referral. Regulators require that the automated system minimize harmful false negatives (missed cases needing referral). Product wants to reduce clinician workload but not at the cost of patient safety. Which monitoring and operational strategy best balances responsible AI risk with efficiency?

Accepted Answer

Route predictions where the model's confidence falls below a calibrated threshold to a human reviewer, and continuously monitor the false-negative rate on reviewed cases to recalibrate the threshold.

Answer

Fully automate all decisions using the model's argmax output and only audit a random 1% sample monthly to control cost.

Answer

Set the classification threshold to maximize overall accuracy, since accuracy is the metric regulators care about most.

Answer

Retrain the model weekly on all new data without human review, assuming continual learning will eliminate false negatives over time.

Question 64

Your team is running Vertex AI hyperparameter tuning on a deep learning model that takes about 6 hours per trial. You have a fixed budget of 40 total trials and want the best possible objective value. You are using Bayesian optimization as the search algorithm. Your manager wants results delivered as quickly as possible, but also wants the search to be as effective as possible. How should you configure the maxParallelTrials setting to balance wall-clock time and search quality?

Accepted Answer

Set maxParallelTrials to a moderate value (e.g., 4-8) so Bayesian optimization can still learn from completed trials while achieving reasonable parallelism.

Answer

Set maxParallelTrials equal to maxTrialCount (40) so all trials run simultaneously and finish in the shortest wall-clock time.

Answer

Set maxParallelTrials to 1 so every trial fully benefits from all prior results, maximizing search quality regardless of time.

Answer

Switch the algorithm to grid search and set maxParallelTrials to 40, since grid search parallelizes without any quality penalty.

Exam domain	Exam weight	Practice
Architecting low-code AI solutions	13%	Practice this topic
Collaborating within and across teams to manage data and models	16%	Practice this topic
Scaling prototypes into ML models	21%	Practice this topic
Serving and scaling models	20%	Practice this topic
Automating and orchestrating ML pipelines	18%	Practice this topic
Monitoring AI solutions	12%	Practice this topic

Professional Machine Learning Engineer (PMLE) practice exam & study guide

Start studying PMLE

All PMLE study resources

PMLE exam domains

Sample PMLE questions

Key PMLE terms

PMLE frequently asked questions

Architecting low-code AI solutions (13%)

Collaborating within and across teams to manage data and models (16%)

Scaling prototypes into ML models (21%)

Serving and scaling models (20%)

Automating and orchestrating ML pipelines (18%)

Monitoring AI solutions (12%)