Monitor and Optimize Infrastructure and Costs

Note

Domain 4: ML Solution Monitoring, Maintenance, and Security

Monitor Infrastructure

Importance of Monitoring ML Infrastructure

Monitoring Performance Metrics

Monitoring and Observability

Monitoring Tools for Performance and Latency

Observability and Auditing Your ML Solution

Setting Up Dashboards

Optimize Infrastructure

Rightsizing Compute Infrastructure for ML Solutions

Demo: Amazon SageMaker Inference Recommender

Optimize Costs

Reducing Monitoring Costs

Balancing Capacity, Cost, and Performance

Using AWS Cost Management Tools with ML Solutions

Purchasing Option to Optimize ML Infrastructure Costs

Resources