59 Practice Questions & Answers
You are designing a machine learning solution that requires real-time feature engineering on streaming data. Which Azure service should you use to process and transform data in real-time before feeding it to your model?
-
A
Azure Stream Analytics
✓ Correct
-
B
Azure Data Factory
-
C
Azure Synapse Analytics
-
D
Azure Databricks only for batch processing
Explanation
Azure Stream Analytics is specifically designed for real-time data processing and transformation of streaming data, making it ideal for real-time feature engineering before model inference.
Your team has built a classification model in Azure Machine Learning that achieves 92% accuracy on the test set but only 78% accuracy in production. What is the most likely cause?
-
A
Data drift or distribution shift between training and production data
✓ Correct
-
B
The test set was too small
-
C
The learning rate was set too high during training
-
D
The model requires more training epochs
Explanation
The significant performance drop between test and production typically indicates that the production data distribution differs from the training data, a phenomenon known as data drift or distribution shift.
You need to implement automated machine learning (AutoML) for a regression problem with 50,000 rows and 200 features. Which Azure service provides AutoML capabilities with minimal configuration?
-
A
Azure SQL Database with built-in ML models
-
B
Azure Stream Analytics
-
C
Azure Machine Learning automated ML
✓ Correct
-
D
Azure Cognitive Services only
Explanation
Azure Machine Learning's automated ML feature automatically selects algorithms, performs feature engineering, and hyperparameter tuning for regression problems with minimal manual configuration.
You are deploying a model to Azure Machine Learning that requires GPU acceleration for inference. Which compute option should you select?
-
A
App Service with Basic tier
-
B
CPU-only compute instances
-
C
Azure Functions with default runtime
-
D
GPU compute clusters with appropriate VM sizes like Standard_NC6
✓ Correct
Explanation
GPU compute clusters with appropriate VM sizes (such as NC-series) provide the necessary GPU acceleration for inference-heavy workloads in Azure Machine Learning.
Your data science team wants to collaborate on a machine learning project with version control for code, data, and models. Which Azure service provides integrated experiment tracking and model registry?
-
A
Azure Machine Learning workspace with MLflow integration
✓ Correct
-
B
Azure DevOps Repos with manual tracking
-
C
GitHub without enterprise features
-
D
Azure Blob Storage with naming conventions
Explanation
Azure Machine Learning workspace provides built-in experiment tracking, model registry, and MLflow integration for comprehensive version control of code, data, and models.
You need to detect anomalies in time-series sensor data from IoT devices. Which Azure Cognitive Service is best suited for this task?
-
A
Language Understanding (LUIS)
-
B
Computer Vision API
-
C
Anomaly Detector API
✓ Correct
-
D
Text Analytics API
Explanation
The Anomaly Detector API in Azure Cognitive Services is specifically designed to detect anomalies in time-series data using advanced machine learning algorithms.
You are implementing a feature store for your organization to manage and serve features across multiple ML models. Which technology combination would be most appropriate?
-
A
Azure SQL Database with scheduled jobs only
-
B
Azure Blob Storage with manual feature engineering scripts
-
C
Azure Synapse Analytics with Delta Lake and MLflow for feature management
✓ Correct
-
D
Local CSV files with pandas DataFrames
Explanation
Azure Synapse Analytics combined with Delta Lake provides versioning and ACID transactions for features, while MLflow enables feature tracking and serving across multiple models.
Your machine learning model must comply with GDPR requirements, including the right to be forgotten. How should you design your data pipeline to support this requirement?
-
A
Archive all data in cold storage after model training completion
-
B
Use only anonymized data that cannot be traced back to individuals
-
C
Implement a data lineage system that enables deletion of specific customer records from training data and retraining of affected models
✓ Correct
-
D
Store raw data indefinitely and delete model predictions after 30 days
Explanation
Supporting GDPR's right to be forgotten requires the ability to identify which training data belongs to a customer, remove it, and retrain models—necessitating proper data lineage and pipeline design.
You are creating a batch prediction pipeline that must run daily and generate predictions for 10 million records. What is the most cost-effective compute option?
-
A
Always-on GPU compute cluster
-
B
Auto-scaling batch compute cluster that scales to zero when not in use
✓ Correct
-
C
Single large virtual machine running 24/7
-
D
Serverless compute with Azure Functions
Explanation
Auto-scaling batch compute clusters can scale down to zero nodes when the job completes, minimizing costs while handling the large volume of predictions efficiently.
Your team needs to monitor model performance in production and receive alerts when accuracy drops below 85%. Which Azure service should you implement?
-
A
Azure Application Insights with custom metrics and alerts
✓ Correct
-
B
Azure Data Factory scheduling
-
C
Azure Logic Apps without monitoring
-
D
Azure Monitor only
Explanation
Azure Application Insights enables custom metric tracking for model accuracy and can trigger alerts based on defined thresholds, making it ideal for model performance monitoring.
You are designing a deep learning solution using TensorFlow that requires distributed training across multiple GPUs in Azure. Which service is most appropriate?
-
A
Azure Cosmos DB with built-in ML
-
B
Azure SQL Managed Instance
-
C
Azure Machine Learning with Horovod or PyTorch distributed training support
✓ Correct
-
D
Azure App Service with TensorFlow runtime
Explanation
Azure Machine Learning supports distributed deep learning training across multiple GPUs using frameworks like Horovod, enabling efficient scaling of TensorFlow workloads.
Your organization wants to implement responsible AI practices by explaining model predictions to stakeholders. Which Azure tool provides model explainability?
-
A
Azure Machine Learning Responsible AI dashboard with SHAP and LIME
✓ Correct
-
B
Azure Bot Service
-
C
Azure Cognitive Search
-
D
Azure Text Analytics
Explanation
The Azure Machine Learning Responsible AI dashboard integrates SHAP and LIME to provide model-agnostic and model-specific explanations for individual predictions.
You need to prepare unstructured image data for a computer vision model. Which Azure service can help with data labeling and annotation at scale?
-
A
Azure Data Factory
-
B
Azure Cognitive Services Computer Vision
-
C
Azure Machine Learning Data Labeling
✓ Correct
-
D
Azure Blob Storage only
Explanation
Azure Machine Learning Data Labeling provides tools for efficient annotation of images at scale with support for human labelers and machine-assisted labeling.
Your predictive maintenance model must make real-time decisions on edge devices with limited connectivity. What is the best deployment strategy?
-
A
Export and deploy the model to Azure IoT Edge devices
✓ Correct
-
B
Use Azure Functions with HTTP triggers exclusively
-
C
Deploy only to cloud endpoints and maintain constant internet connection
-
D
Retrain the model on each device locally
Explanation
Azure IoT Edge enables deployment of machine learning models to edge devices, allowing real-time inference without constant cloud connectivity.
You are working with imbalanced classification data where the positive class represents only 2% of samples. Which technique should you apply?
-
A
Use SMOTE oversampling, adjust class weights, or use stratified cross-validation
✓ Correct
-
B
Ignore the imbalance and train with standard settings
-
C
Collect more positive samples before any modeling
-
D
Remove all negative samples to create balance
Explanation
SMOTE oversampling, class weight adjustment, and stratified cross-validation are effective techniques for handling imbalanced datasets without losing information.
You need to create a machine learning pipeline that retrains models automatically when data quality issues are detected. How should you design this?
-
A
Retrain all models every hour regardless of data quality
-
B
Manually inspect data daily and trigger retraining
-
C
Implement retraining only during scheduled maintenance windows
-
D
Use Azure Data Factory with data quality checks triggering Azure Machine Learning retraining pipelines
✓ Correct
Explanation
Azure Data Factory can monitor data quality metrics and conditionally trigger Azure Machine Learning retraining pipelines when anomalies or quality issues are detected.
Your team wants to conduct hyperparameter tuning for a model with 15 different hyperparameters. Which Azure approach is most efficient?
-
A
Randomly select hyperparameters without systematic approach
-
B
Azure Machine Learning HyperDrive with Bayesian sampling
✓ Correct
-
C
Manual grid search with sequential testing
-
D
Use default hyperparameters from scikit-learn documentation
Explanation
Azure Machine Learning HyperDrive with Bayesian sampling intelligently explores the hyperparameter space more efficiently than grid search, reducing computational cost.
You are deploying a model that must maintain sub-100ms inference latency for a web application. Which deployment option best meets this requirement?
-
A
Real-time inference endpoint with GPU compute
✓ Correct
-
B
Export model to flat files and load manually
-
C
Scheduled inference every hour
-
D
Batch inference with daily predictions
Explanation
Real-time inference endpoints with GPU compute provide the low-latency response times required for interactive web applications (sub-100ms).
You need to implement cross-validation for a time-series forecasting model. Which validation strategy is appropriate?
-
A
Time-series split where training data always precedes test data
✓ Correct
-
B
Random k-fold cross-validation
-
C
Shuffled stratified k-fold
-
D
Leave-one-out cross-validation on all samples
Explanation
Time-series split ensures that test data always comes after training data in temporal order, preventing data leakage and providing realistic performance estimates.
Your organization processes sensitive healthcare data that must not leave your on-premises infrastructure. How can you leverage Azure services?
-
A
Only use on-premises solutions without any Azure services
-
B
Upload all data to Azure after encryption
-
C
Use Azure Stack Hub to run Azure services on-premises while maintaining data locality
✓ Correct
-
D
Use Azure's public cloud exclusively regardless of regulations
Explanation
Azure Stack Hub allows you to deploy Azure services on-premises, enabling the use of Azure Machine Learning and other services while maintaining data locality for compliance.
You are building a recommendation system that requires collaborative filtering with millions of user-item interactions. Which Azure service is best suited?
-
A
Azure Blob Storage with custom Python scripts only
-
B
Azure SQL Database with stored procedures
-
C
Azure Cognitive Services Personalizer for simple personalization
-
D
Azure Machine Learning with Spark MLlib algorithms
✓ Correct
Explanation
Azure Machine Learning with Spark MLlib provides scalable collaborative filtering algorithms capable of handling millions of interactions efficiently on distributed computing.
You need to ensure reproducibility of your machine learning experiments. Which practice is most important?
-
A
Change hyperparameters frequently to avoid overfitting
-
B
Run experiments on different machines to test robustness
-
C
Set random seeds, track parameters, dependencies, and data versions in Azure Machine Learning
✓ Correct
-
D
Document results in a Word document without version control
Explanation
Reproducibility requires setting random seeds, tracking all parameters and dependencies, and versioning data and code—all supported by Azure Machine Learning's experiment tracking.
Your model inference service is experiencing high latency during peak hours. What is the first diagnostic step you should take?
-
A
Use Azure Machine Learning's model profile tool and Application Insights to identify bottlenecks
✓ Correct
-
B
Increase the API timeout limit indefinitely
-
C
Replace the model with a simpler one
-
D
Immediately scale up compute resources without investigation
Explanation
Azure Machine Learning's model profile tool and Application Insights reveal whether latency is caused by model inference, data preprocessing, or infrastructure issues.
You are implementing a fair AI solution that must ensure equal performance across demographic groups. Which Azure tool helps identify and mitigate bias?
-
A
Azure Machine Learning Fairlearn integration for bias detection and mitigation
✓ Correct
-
B
Azure Cognitive Services Text Analytics
-
C
Azure Synapse Analytics query performance advisor
-
D
Azure Data Factory data movement logs
Explanation
Azure Machine Learning integrates Fairlearn for measuring and mitigating bias across demographic groups, enabling fair AI implementation throughout the model lifecycle.
You are designing a machine learning solution on Azure. Which service should you use to automatically train multiple models and select the best one based on a specified metric?
-
A
Azure Machine Learning automated ML
✓ Correct
-
B
Azure Databricks cluster configuration
-
C
Azure Synapse Analytics
-
D
Azure Data Factory pipeline activities
Explanation
Azure Machine Learning's automated ML feature automatically trains multiple models and selects the best performer based on your chosen metric, reducing manual model development time.
When registering a dataset in Azure Machine Learning, which approach allows you to version your data assets and track lineage?
-
A
Storing raw files in Azure Blob Storage without registration
-
B
Using Data Store connections only
-
C
Creating manual CSV copies in local folders
-
D
Registering datasets through the ML SDK or Studio UI
✓ Correct
Explanation
Registering datasets in Azure ML enables versioning, lineage tracking, and reproducibility across experiments and pipelines.
You need to deploy a trained model as a web service that can handle real-time inference requests. Which Azure service is most appropriate?
-
A
Azure Machine Learning real-time endpoints
✓ Correct
-
B
Azure Data Lake Storage
-
C
Azure Stream Analytics
-
D
Azure Batch AI
Explanation
Azure ML real-time endpoints (managed online endpoints) provide low-latency inference serving for real-time prediction requests with automatic scaling.
Your team wants to track experiment metrics, parameters, and artifacts across multiple training runs. Which Azure ML feature should you implement?
-
A
MLflow tracking integrated with Azure ML
✓ Correct
-
B
Git commit history
-
C
Azure Blob Storage versioning
-
D
Azure Monitor only
Explanation
MLflow tracking in Azure ML automatically logs parameters, metrics, and artifacts for each experiment run, enabling comparison and reproducibility across multiple training iterations.
You are configuring a compute cluster for training jobs that require GPU resources. Which compute type in Azure ML should you select?
-
A
Function Apps
-
B
Logic Apps
-
C
Serverless compute
-
D
Compute clusters with GPU VMs
✓ Correct
Explanation
Compute clusters with GPU-enabled virtual machines (such as NC or ND series) are designed for compute-intensive training workloads requiring GPU acceleration.
When using Azure Machine Learning pipelines, what is the primary benefit of defining steps as pipeline steps rather than running all code sequentially?
-
A
Direct cost per training run reduction
-
B
Elimination of the need for source control
-
C
Reduced storage costs
-
D
Automatic parallelization, reusability, and partial rerun capabilities
✓ Correct
Explanation
ML pipelines enable modular workflows where steps can run in parallel, be reused across experiments, and individually rerun without re-executing the entire workflow.
You need to ensure that your model is fair and does not exhibit bias against protected attributes. Which Azure ML capability should you use?
-
A
Azure Cognitive Services only
-
B
Manual code review processes
-
C
Fairlearn integration with Azure ML
✓ Correct
-
D
Azure SQL Database constraints
Explanation
Fairlearn, integrated with Azure ML, provides tools to assess and mitigate bias in machine learning models across different demographic groups.
Your organization requires that model training code and data remain within a specific geographic region for compliance. Which Azure ML feature addresses this requirement?
-
A
Experiment naming conventions
-
B
Workspace region selection and private endpoints
✓ Correct
-
C
Model versioning tags
-
D
Public internet connectivity settings
Explanation
Selecting a specific workspace region and configuring private endpoints ensures data and compute resources stay within the required geographic boundary for compliance.
When implementing feature engineering in an Azure ML pipeline, what is the recommended practice for handling missing values?
-
A
Apply imputation strategies within the training pipeline as a discrete step
✓ Correct
-
B
Manually fill missing values with random numbers
-
C
Use raw data and let the model handle missing values
-
D
Remove all rows with missing values before training
Explanation
Implementing imputation as a distinct pipeline step ensures consistent preprocessing, prevents data leakage, and maintains reproducibility across training and scoring.
You are designing a model that must explain its predictions to end users. Which Azure service provides explainability through feature importance and local explanations?
-
A
Azure Application Insights only
-
B
Azure Bot Service
-
C
Interpret ML SDK integrated with Azure ML
✓ Correct
-
D
Azure Cognitive Services Text Analytics
Explanation
The Interpret ML SDK provides feature importance rankings and local explanations (SHAP, LIME) to help understand and explain model predictions.
Your deployed model experiences performance degradation over time. Which technique should you implement to monitor and detect this issue?
-
A
Disabling the model endpoint temporarily
-
B
Manual monthly model testing
-
C
Retraining the model annually
-
D
Application Insights with custom metrics and drift detection
✓ Correct
Explanation
Implementing data drift and model performance monitoring through Application Insights enables automated detection of model degradation and triggers for retraining.
When designing a hyperparameter tuning strategy, which approach balances computational cost and optimization effectiveness?
-
A
Grid search with exhaustive parameter combinations
-
B
Using default hyperparameters without tuning
-
C
Manual trial-and-error hyperparameter selection
-
D
Random search followed by Bayesian optimization on promising regions
✓ Correct
Explanation
Combining random search exploration with Bayesian optimization refinement provides better efficiency than grid search while requiring fewer iterations than pure random sampling.
You need to implement cross-validation for model evaluation. Why is k-fold cross-validation preferred over a single train-test split?
-
A
It eliminates the need for hyperparameter tuning
-
B
It reduces the total training time required
-
C
It automatically selects the best model architecture
-
D
It provides a more reliable estimate of model performance and reduces variance from data splitting artifacts
✓ Correct
Explanation
K-fold cross-validation uses multiple train-test splits, providing a more robust performance estimate and reducing the impact of random data partitioning effects.
When implementing a recommendation system on Azure, which collaborative filtering approach works best with sparse user-item interaction matrices?
-
A
Rule-based hardcoded recommendations
-
B
Dense matrix multiplication only
-
C
Matrix factorization techniques with dimensionality reduction
✓ Correct
-
D
Content-based filtering exclusively
Explanation
Matrix factorization reduces sparse data into lower-dimensional latent factor representations, enabling efficient similarity computation and handling data sparsity.
Your model requires access to sensitive data during training. Which Azure ML feature provides secure access while maintaining audit trails?
-
A
Storing credentials in plaintext in the code
-
B
Key Vault integration with managed identities
✓ Correct
-
C
Environment variables in pipeline YAML files
-
D
Using shared access signatures without expiration
Explanation
Azure Key Vault with managed identities securely stores credentials and ensures that access is logged, audited, and managed without exposing secrets in code.
When developing a time series forecasting model, which preprocessing technique addresses non-stationary data patterns?
-
A
Increasing the training set size
-
B
Scaling features to 0-1 range only
-
C
Differencing, detrending, or seasonal decomposition
✓ Correct
-
D
Using only the most recent data points
Explanation
Differencing and decomposition techniques remove trends and seasonal patterns, converting non-stationary time series to stationary distributions suitable for forecasting models.
You are implementing an image classification model. Which data augmentation techniques should you apply to improve model robustness?
-
A
Duplicating existing images multiple times
-
B
Applying filters only without geometric transformations
-
C
Random rotation, flipping, brightness adjustment, and cropping
✓ Correct
-
D
Reducing image resolution to increase training speed
Explanation
Data augmentation through rotation, flipping, brightness, and crop variations increases dataset diversity and improves model generalization to unseen images.
When designing a multi-class classification model, which evaluation metric is most appropriate for imbalanced datasets?
-
A
Row count statistics
-
B
Total prediction count
-
C
Accuracy alone
-
D
Macro-averaged F1 score or weighted F1 score
✓ Correct
Explanation
Macro or weighted F1 scores account for class imbalance by averaging metrics across all classes, providing fairer evaluation than accuracy which favors majority classes.
Your organization wants to automate the entire ML lifecycle from data preparation to model deployment. Which Azure service orchestrates this end-to-end workflow?
-
A
Azure Data Factory for scheduling and orchestration
-
B
Azure Logic Apps without ML integration
-
C
Azure Machine Learning pipelines with scheduled triggers
✓ Correct
-
D
Manual bash scripts executed on local machines
Explanation
Azure ML pipelines with scheduled or event-triggered execution automate the complete ML workflow including data prep, training, evaluation, and deployment.
When implementing model inference at scale with high throughput requirements, which deployment option is most suitable?
-
A
Manual inference on a personal laptop
-
B
Batch endpoints with parallel inference on compute clusters
✓ Correct
-
C
Single real-time endpoint on standard SKU
-
D
File-based predictions without automation
Explanation
Batch endpoints enable parallel processing of large datasets across compute clusters, providing high throughput for non-real-time inference scenarios.
You need to validate that your model meets regulatory requirements before deployment. Which Azure ML feature provides compliance documentation and model cards?
-
A
Model packaging and versioning in the registry
-
B
Naming conventions for model files
-
C
Model cards and responsible AI documentation in ML registry
✓ Correct
-
D
Screenshot documentation stored locally
Explanation
The ML registry supports model cards and responsible AI documentation that capture performance metrics, ethical considerations, and compliance information for auditing.
When implementing feature store functionality for a large-scale ML system, which benefit is most critical?
-
A
Guaranteed cost reduction
-
B
Elimination of the need for data engineers
-
C
Reduced storage space requirements
-
D
Reusable feature definitions with consistent computation across training and serving
✓ Correct
Explanation
A feature store ensures features are computed consistently for both training and inference, preventing training-serving skew and enabling feature reuse across models.
Your model performance varies significantly across different customer segments. Which strategy addresses this issue?
-
A
Removing underperforming segments from analysis
-
B
Training a single global model and accepting performance variation
-
C
Disabling predictions for certain customer groups
-
D
Developing segment-specific models or implementing stratified evaluation with group fairness metrics
✓ Correct
Explanation
Segment-specific models or stratified evaluation with fairness metrics enable identifying and addressing performance gaps across customer groups rather than masking them.
When designing a deep learning solution on Azure, which framework integration provides GPU acceleration and distributed training?
-
A
Jupyter Notebooks without GPU support only
-
B
Excel spreadsheets with manual calculations
-
C
PyTorch or TensorFlow with Azure ML compute clusters
✓ Correct
-
D
Pure Python without any ML libraries
Explanation
PyTorch and TensorFlow integrate with Azure ML compute clusters to leverage GPU acceleration and support distributed training across multiple nodes.
You are implementing a model with privacy-preserving requirements. Which technique enables training without exposing individual records?
-
A
Differential privacy implementation or federated learning approaches
✓ Correct
-
B
Removing all demographic information from features
-
C
Storing raw data in public cloud storage
-
D
Aggregated data summarization at the feature level
Explanation
Differential privacy adds statistical noise to preserve individual privacy during training, while federated learning trains on distributed data without centralizing sensitive records.
You are building a machine learning model to predict customer churn. You need to handle imbalanced data where only 5% of customers churn. Which technique should you apply during model training to address this class imbalance?
-
A
Use stratified k-fold cross-validation and adjust class weights in your model
✓ Correct
-
B
Increase the learning rate to force faster convergence
-
C
Train only on the minority class samples
-
D
Remove all non-churning customers from the dataset
Explanation
Stratified k-fold cross-validation preserves class distribution in each fold, and adjusting class weights penalizes misclassification of the minority class more heavily, which is the standard approach for imbalanced classification problems.
You have deployed a machine learning model in Azure Machine Learning that predicts house prices. After deployment, you notice the model's predictions are increasingly inaccurate over time. What is the primary cause and recommended action?
-
A
The Azure compute cluster needs to be scaled up immediately
-
B
The REST endpoint authentication tokens have expired
-
C
Model drift has occurred; retrain the model with recent data and implement monitoring
✓ Correct
-
D
The feature engineering pipeline has corrupted the input features
Explanation
Model drift occurs when the statistical properties of input features change over time, causing model performance degradation. The solution is to monitor predictions, retrain periodically with recent data, and detect data drift automatically using Azure ML's monitoring capabilities.
You are designing a data science solution that requires real-time inference on streaming data. The model must respond within 100ms. Which Azure service should you use for model deployment?
-
A
Azure Batch AI for distributed training
-
B
Azure Databricks for interactive notebook processing
-
C
Azure Kubernetes Service (AKS) with optimized container deployment
✓ Correct
-
D
Azure Container Instances with a REST endpoint
Explanation
Azure Kubernetes Service provides the orchestration, scalability, and low-latency inference capabilities required for real-time streaming scenarios with strict response time requirements. AKS can auto-scale based on demand and provides better performance than Container Instances.
You need to prepare training data for a computer vision model that classifies defects in manufacturing. The dataset contains 50,000 images stored in Azure Blob Storage. What is the most efficient approach to load and preprocess this data for training?
-
A
Use Azure Machine Learning Datasets with mount or download options and apply preprocessing during training
✓ Correct
-
B
Download all images locally, preprocess them, and upload to the compute target
-
C
Copy images to the compute node's temporary storage before training starts
-
D
Load images one at a time in Python using the Azure Storage SDK
Explanation
Azure ML Datasets provide efficient data handling with caching, versioning, and integration with training pipelines. They support both mount (streaming) and download modes, and preprocessing can be applied efficiently during training without manual file management.
You are implementing hyperparameter tuning for a neural network model using Azure Machine Learning's HyperDrive service. You want to balance exploration and exploitation efficiently. Which sampling method should you use?
-
A
Random sampling followed by early termination of underperforming runs
-
B
Manual sampling by specifying individual parameter values
-
C
Grid sampling to exhaustively search all parameter combinations
-
D
Bayesian sampling with an early termination policy
✓ Correct
Explanation
Bayesian sampling uses information from previous runs to intelligently select promising hyperparameter combinations, which balances exploration and exploitation better than random or grid sampling. Combined with early termination, it efficiently finds optimal hyperparameters while reducing compute costs.
You have built a classification model and need to evaluate its performance. Your dataset has 100,000 samples with 95% belonging to the negative class. Which metric should you prioritize when selecting the best model?
-
A
F1-score or area under the precision-recall curve, as they account for class imbalance
✓ Correct
-
B
Specificity, as it is most relevant for the negative class
-
C
Sensitivity alone, as it measures true positive rate
-
D
Accuracy, as it measures overall correctness
Explanation
With highly imbalanced data, accuracy is misleading because a model can achieve 95% accuracy by simply predicting the majority class. F1-score and precision-recall curves appropriately weight both classes and provide meaningful performance assessment for imbalanced datasets.
You need to deploy a machine learning model as a web service in Azure with authentication. Which deployment option requires you to manage authentication keys and allows containerized deployment?
-
A
Azure Functions with a direct model binding
-
B
Azure Container Instances or AKS with authentication configured in the scoring script
✓ Correct
-
C
Azure App Service only
-
D
Azure Machine Learning managed endpoints with system-managed identity
Explanation
Deploying to Azure Container Instances or AKS gives you direct control over authentication mechanisms, allows you to implement API keys or other authentication schemes in the scoring script, and supports containerized model serving with full customization.
You are training a deep learning model for natural language processing on Azure Machine Learning. The training job uses GPU compute and runs for 12 hours. How should you configure the compute to optimize cost while maintaining performance?
-
A
Use only dedicated VMs regardless of cost
-
B
Use CPU-only compute to reduce expenses
-
C
Use spot instances with sufficient time to handle potential interruptions
-
D
Use low-priority VMs for the training compute cluster
✓ Correct
Explanation
Low-priority VMs in Azure provide significant cost savings (up to 90%) for interruptible workloads. For a 12-hour training job, low-priority VMs are suitable because checkpointing and resumption can be implemented, and the risk of preemption can be managed with appropriate retry policies.
Your organization requires that all machine learning models comply with specific regulatory standards. What feature should you use in Azure Machine Learning to ensure model interpretability and generate compliance reports?
-
A
Manual documentation of model decisions in text files
-
B
Model versioning alone without additional explanation techniques
-
C
Model explanations using SHAP or LIME integrated with Azure ML Interpretability
✓ Correct
-
D
Automated feature selection without documentation
Explanation
Azure Machine Learning's Interpretability SDK provides SHAP and LIME integrations to explain feature importance and individual predictions, which is essential for regulatory compliance and model transparency. This generates interpretable reports required by compliance frameworks.
You are designing a machine learning pipeline in Azure that includes data preparation, feature engineering, model training, and evaluation. The pipeline must be reproducible and should not rerun completed steps unnecessarily. What should you implement?
-
A
Use Azure ML Pipelines with published pipeline endpoints
-
B
Write separate Python scripts for each step without dependencies
-
C
Execute all steps in a single notebook sequentially
-
D
Use Azure ML Pipelines with PipelineData objects and caching to enable step reuse
✓ Correct
Explanation
Azure ML Pipelines with PipelineData objects establish explicit data dependencies between steps, and the caching mechanism prevents rerunning unchanged steps, ensuring reproducibility while optimizing compute costs. Published endpoints allow for easy retraining and deployment.