Description
In this course, the students will explore each stage of the data platform modernization process and define what tasks are involved at each stage, such as the assessment and planning phase. Students will also learn the available migration tools and how they are suitable for each stage of the data migration process. The students will learn how to migrate to the three target platforms for SQL based workloads: SQL Virtual Machines with RM and Azure SQL Database Managed Instances. The students will learn the benefits and limitations of each target platform and how they can be used to fulfil both business and technical requirements for modern SQL workloads.
The students will also learn about the data engineering patterns and practices as it pertains to working with batch and real-time analytical solutions using Azure data platform technologies. They will explore how to design an analytical serving layers and focus on data engineering considerations for working with source files.
Course Duration: 4 Day(s)
Highlights
Explore compute and storage options for data engineering workloads
- Introduction to Azure Storage Account
- Describe the different Storage options in Azure Storage
- Introduction to Azure SQL Database
- Describe Azure SQL Database Architecture
- Understand SQL Database hosting models
- Introduction to Azure Synapse Analytics
- Describe Azure Databricks
- Introduction to Azure Data Lake storage
- Describe Delta Lake architecture
- Work with data streams by using Azure Stream Analytics
Plan and Implement SQL Database resources
- Deploying SQL Server using IaaS
- Deploying SQL Server using PaaS
- Azure SQL Database Deployment Options o Azure SQL Database Purchasing Models
Introducing Data Platform Modernization
- Understand Data Platform Modernization
- Understanding the stages of migration
- Data Migration Paths
Data Migration from on-premises SQL Server to Azure
- Scenarios for Migration in Data Platform Modernization
- Choosing the right tools for Migration
- Identify Migration candidates using Data Migration Assistant
- Evaluate a Data workload using Database Experimentation Assistant o Data Migration using Azure Database Migration Service
- Migrate non-SQL Server workloads to Azure using SQL Migration Assistant
- Migrating SQL Workloads to Azure Virtual Machines
- Migrate SQL Workloads to Azure SQL Databases
- Migrate SQL Workloads to Azure SQL Database Managed Instance
Introduction to Azure SQL Synapse Analytics for Analytical processing
- Describe Azure SQL Synapse Analytics
- Creating and Querying an Azure SQL Synapse Analytics
Design and implement a Modern Data Warehouse
- Design a Modern Data Warehouse using Azure Synapse Analytics
- Design a multidimensional schema to optimize analytical workloads
Migrate SQL Workloads and Data Engineering on Azure
- Code-free transformation at scale with Azure Data Factory
- Populate slowly changing dimensions in Azure Synapse Analytics pipelines
Run interactive queries using Azure Synapse Analytics serverless SQL pools
- Explore Azure Synapse serverless SQL pools capabilities
- Query data in the lake using Azure Synapse serverless SQL pools
- Create metadata objects in Azure Synapse serverless SQL pools
- Secure data and manage users in Azure Synapse serverless SQL pools
Ingest and load data into the data warehouse
- Use data loading best practices in Azure Synapse Analytics
- Import data with PolyBase and COPY using T-SQL
- Petabyte-scale ingestion with Azure Data Factory
- Perform petabyte-scale ingestion with Azure Synapse Pipelines
Transform data with Azure Data Factory or Azure Synapse Pipelines
- Data integration with Azure Data Factory or Azure Synapse Pipelines
- Code-free transformation at scale with Azure Data Factory or Azure Synapse Pipelines
- Create data pipeline to import poorly formatted CSV files
- Create Mapping Data Flows
Personas
Data Engineer & Data Analyst