This is an example of a simple banner

Training: Data Engineering on Microsoft Azure (DP-203)

Ref. DP-203T00
Duration:
4
 days
Exam:
Optional
Level:
Intermediate

Data Engineering on Microsoft Azure (DP-203)

This Data Engineering on Microsoft Azure (DP-203) course will introduce you to data engineering models and practices within the context of real-time and batch analytical solutions using Azure data platform technologies.

You will learn about the fundamental computing and storage technologies used to build an analytical solution and then explore how to design analytical service layers, focusing on data engineering considerations for working with source files.

Through this Data Engineering on Microsoft Azure course, you will learn to interactively explore data stored in files in a data lake, the different ingestion techniques that can be used to load data using Apache Spark functionality in Azure Synapse Analytics or Azure Databricks, or how to ingest data using Azure Data Factory or Azure Synapse pipelines.

You will also cover the various ways to transform data using the same technologies used for data acquisition and learn how to monitor and analyze the performance of analytical systems to optimize the performance of data loads or queries on the systems. Finally, you will understand the importance of implementing security to ensure data protection at rest or in transit.

Participant profiles

  • Data professionals, data architects, and business intelligence professionals who want to learn about data engineering and building analytical solutions using data platform technologies that exist on Microsoft Azure
  • Data analysts and data scientists who work with analytical solutions built on Microsoft Azure

Objectives

  • Explore compute and storage options for data engineering workloads in Azure
  • Run interactive queries using serverless SQL pools
  • Perform data Exploration and Transformation in Azure Databricks
  • Explore, transform, and load data into the Data Warehouse using Apache Spark
  • Ingest and load Data into the Data Warehouse
  • Transform Data with Azure Data Factory or Azure Synapse Pipelines
  • Integrate Data from Notebooks with Azure Data Factory or Azure Synapse Pipelines
  • Support Hybrid Transactional Analytical Processing (HTAP) with Azure Synapse Link
  • Perform end-to-end security with Azure Synapse Analytics
  • Perform real-time Stream Processing with Stream Analytics
  • Create a Stream Processing Solution with Event Hubs and Azure Databricks

Prerequisites

Course content

Module 1: Explore compute and storage options for data engineering workloads

  • Introduction to Azure Synapse Analytics
  • Describe Azure Databricks
  • Introduction to Azure Data Lake storage
  • Describe Delta Lake architecture
  • Work with data streams by using Azure Stream Analytics

Module 2: Run interactive queries using Azure Synapse Analytics serverless SQL pools

  • Explore Azure Synapse serverless SQL pools capabilities
  • Query data in the lake using Azure Synapse serverless SQL pools
  • Create metadata objects in Azure Synapse serverless SQL pools
  • Secure data and manage users in Azure Synapse serverless SQL pools

Module 3: Data exploration and transformation in Azure Databricks

  • Describe Azure Databricks
  • Read and write data in Azure Databricks
  • Work with DataFrames in Azure Databricks
  • Work with DataFrames advanced methods in Azure Databricks

Module 4: Explore, transform, and load data into the Data Warehouse using Apache Spark

  • Understand big data engineering with Apache Spark in Azure Synapse Analytics
  • Ingest data with Apache Spark notebooks in Azure Synapse Analytics
  • Transform data with DataFrames in Apache Spark Pools in Azure Synapse Analytics
  • Integrate SQL and Apache Spark pools in Azure Synapse Analytics

Module 5: Ingest and load data into the data warehouse

  • Use data loading best practices in Azure Synapse Analytics
  • Petabyte-scale ingestion with Azure Data Factory

Module 6: Transform data with Azure Data Factory or Azure Synapse Pipelines

  • Data integration with Azure Data Factory or Azure Synapse Pipelines
  • Code-free transformation at scale with Azure Data Factory or Azure Synapse Pipelines

Module 7: Orchestrate data movement and transformation in Azure Synapse Pipelines

  • Orchestrate data movement and transformation in Azure Data Factory

Module 8: End-to-end security with Azure Synapse Analytics

  • Secure a data warehouse in Azure Synapse Analytics
  • Configure and manage secrets in Azure Key Vault
  • Implement compliance controls for sensitive data

Module 9: Support Hybrid Transactional Analytical Processing (HTAP) with Azure Synapse Link

  • Design hybrid transactional and analytical processing using Azure Synapse Analytics
  • Configure Azure Synapse Link with Azure Cosmos DB
  • Query Azure Cosmos DB with Apache Spark pools
  • Query Azure Cosmos DB with serverless SQL pools

Module 10: Real-time Stream Processing with Stream Analytics

  • Enable reliable messaging for Big Data applications using Azure Event Hubs
  • Work with data streams by using Azure Stream Analytics
  • Ingest data streams with Azure Stream Analytics

Module 11: Create a Stream Processing Solution with Event Hubs and Azure Databricks

  • Process streaming data with Azure Databricks structured streaming

Documentation

  • Access to Microsoft Learn (online learning content)

Lab / Exercises

Official Microsoft Labs

  • Lab 1: Explore compute and storage options for data engineering workloads
  • Lab 2: Run interactive queries using serverless SQL pools
  • Lab 3: Data Exploration and Transformation in Azure Databricks
  • Lab 4: Explore, transform, and load data into the Data Warehouse using Apache Spark
  • Lab 5: Ingest and load Data into the Data Warehouse
  • Lab 6: Transform Data with Azure Data Factory or Azure Synapse Pipelines
  • Lab 7: Orchestrate data movement and transformation in Azure Synapse Pipelines
  • Lab 8: End-to-end security with Azure Synapse Analytics
  • Lab 9: Support Hybrid Transactional Analytical Processing (HTAP) with Azure Synapse Link
  • Lab 10: Real-time Stream Processing with Stream Analytics
  • Lab 11: Create a Stream Processing Solution with Event Hubs and Azure Databricks

Exam

  • This course prepares you to the DP-203 : Data Engineering on Microsoft Azure exam. If you wish to take this exam, please contact our secretariat who will let you know the cost of the exam and will take care of all the necessary administrative procedures for you.

Complementary courses

Temptraining funding

ITTA is a partner of Temptraining, the continuing education fund for temporary workers. This training fund can subsidize continuing education for anyone who works for an employer subject to the Collective Work Agreement (CCT) Rental of services.

Additional information

Data Engineering on Microsoft Azure (DP-203) Training

Optimize Your Data Engineering Skills with Azure

The Data Engineering on Microsoft Azure (DP-203) training offers you a unique opportunity to master the essential Azure tools and services for data engineering. Here is an overview of the main aspects of this training and the skills you will acquire.

Understanding Azure Synapse Analytics and Azure Databricks

Azure Synapse Analytics is an end-to-end solution for ingesting, preparing, managing, and providing data for immediate BI and machine learning needs. You will discover how this unified platform combines big data processing technologies and data warehouses, making it easier to manage complex analytical workloads.

Azure Databricks, based on Apache Spark, is designed for Big Data analytics. It allows data engineers to collaborate effectively while easily integrating with other Azure services for end-to-end analytics.

Data Storage and Management with Azure Data Lake

Data storage is crucial for any data infrastructure. Azure Data Lake offers a scalable and high-performance solution for storing and managing large amounts of structured and unstructured data. You will learn how to leverage its capabilities to optimize your data engineering workloads.

Delta Lake Architecture and Real-Time Data Streams

The Delta Lake architecture combines the advantages of data lakes and data warehouses, enabling more efficient data management and improved query performance. Additionally, with Azure Stream Analytics, you will be able to analyze real-time data streams, which is essential for gaining instant insights and making informed decisions.

Designing and Implementing Robust Data Solutions

A data engineer on Azure must be able to design optimized multidimensional schemas for analytical workloads. This training will help you understand how to create robust data architectures that support complex analytics while ensuring scalability and performance.

Data Security and Management in Azure

Data security is a priority. You will learn how to secure your data warehouses using Azure’s best practices, including Azure Key Vault for managing secrets and keys. The training also covers necessary compliance controls to protect sensitive data.

Large-Scale Data Orchestration and Transformation

Data orchestration and transformation are essential for any effective data solution. With Azure Data Factory and Azure Synapse pipelines, you will be able to automate and manage large-scale data flows, using no-code transformations to simplify processes.

Query Performance Optimization

Query performance optimization is crucial for ensuring fast response times and efficient resource usage. You will learn techniques to optimize query performance in Azure Synapse Analytics, which is essential for effectively managing data warehouses.

Supporting HTAP with Azure Synapse Link

Hybrid Transactional and Analytical Processing (HTAP) is supported by Azure Synapse Link, which allows direct connection of transactional databases with analytical services. This integration enables real-time analytics without impacting transactional operations.

Power BI Integration for Interactive Reports

Creating interactive reports with Power BI integrated into Azure Synapse Analytics will enable you to visualize and explore your data intuitively, facilitating data-driven decision-making with up-to-date and accurate data.

Common Questions about DP-203 and the Role of a Data Engineer on Azure

What is DP-203 in Azure?
DP-203 is a certification exam for data engineers on Microsoft Azure. It assesses your skills in designing and implementing data management solutions using Azure services such as Azure Synapse Analytics, Azure Data Factory, and Azure Databricks.

What does a Microsoft Azure Data Engineer do?
A data engineer on Microsoft Azure is responsible for designing, implementing, and managing data solutions that enable organizations to collect, store, transform, and analyze large amounts of data. They use Azure tools and services to automate data flows, ensure security, and optimize data system performance.

By following this Data Engineering on Microsoft Azure (DP-203) training, you will acquire the necessary skills to excel as a data engineer on Azure, preparing you to tackle the challenges of modern data engineering.

Prix de l'inscription
CHF 3'000.-
Inclus dans ce cours
  • Training provided by a certified trainer
  • 180 days of access to Official Microsoft Labs
  • Official documentation in digital format
  • Official Microsoft achievement badge
Mois actuel

lun16Sep(Sep 16)09:00jeu19(Sep 19)17:00VirtuelVirtual Etiquettes de sessionDP-203T00

lun16Sep(Sep 16)09:00jeu19(Sep 19)17:00Lausanne, Avenue Mon repos 24, 1005 Lausanne Etiquettes de sessionDP-203T00

lun21Oct(Oct 21)09:00jeu24(Oct 24)17:00VirtuelVirtual Etiquettes de sessionDP-203T00

lun21Oct(Oct 21)09:00jeu24(Oct 24)17:00Genève, Route des Jeunes 35, 1227 Carouge Etiquettes de sessionDP-203T00

lun25Nov(Nov 25)09:00jeu28(Nov 28)17:00VirtuelVirtual Etiquettes de sessionDP-203T00

lun25Nov(Nov 25)09:00jeu28(Nov 28)17:00Lausanne, Avenue Mon repos 24, 1005 Lausanne Etiquettes de sessionDP-203T00

Contact

ITTA
Route des jeunes 35
1227 Carouge, Suisse

Opening hours

Monday to Friday
8:30 AM to 6:00 PM
Tel. 058 307 73 00

Contact-us

ITTA
Route des jeunes 35
1227 Carouge, Suisse

Make a request

Contact

ITTA
Route des jeunes 35
1227 Carouge, Suisse

Opening hours

Monday to Friday, from 8:30 am to 06:00 pm.

Contact us

Your request