Azure Data Engineer Associate Certification Guide: A hands-on reference guide to developing your data engineering skills and preparing for the DP-203

Key Features

• Understand and apply data engineering concepts to real-world problems and prepare for the DP-203 certification exam
• Explore the various Azure services for building end-to-end data solutions
• Gain a solid understanding of building secure and sustainable data solutions using Azure services

Book Description

Azure is one of the leading cloud providers in the world, providing numerous services for data hosting and data processing. Most of the companies today are either cloud-native or are migrating to the cloud much faster than ever. This has led to an explosion of data engineering jobs, with aspiring and experienced data engineers trying to outshine each other.

Gaining the DP-203: Azure Data Engineer Associate certification is a sure-fire way of showing future employers that you have what it takes to become an Azure Data Engineer. This book will help you prepare for the DP-203 examination in a structured way, covering all the topics specified in the syllabus with detailed explanations and exam tips. The book starts by covering the fundamentals of Azure, and then takes the example of a hypothetical company and walks you through the various stages of building data engineering solutions. Throughout the chapters, you'll learn about the various Azure components involved in building the data systems and will explore them using a wide range of real-world use cases. Finally, you'll work on sample questions and answers to familiarize yourself with the pattern of the exam.

By the end of this Azure book, you'll have gained the confidence you need to pass the DP-203 exam with ease and land your dream job in data engineering.

What you will learn

• Gain intermediate-level knowledge of Azure the data infrastructure
• Design and implement data lake solutions with batch and stream pipelines
• Identify the partition strategies available in Azure storage technologies
• Implement different table geometries in Azure Synapse Analytics
• Use the transformations available in T-SQL, Spark, and Azure Data Factory
• Use Azure Databricks or Synapse Spark to process data using Notebooks
• Design security using RBAC, ACL, encryption, data masking, and more
• Monitor and optimize data pipelines with debugging tips

Who this book is for

This book is for data engineers who want to take the DP-203: Azure Data Engineer Associate exam and are looking to gain in-depth knowledge of the Azure cloud stack.

The book will also help engineers and product managers who are new to Azure or interviewing with companies working on Azure technologies, to get hands-on experience of Azure data technologies. A basic understanding of cloud technologies, extract, transform, and load (ETL), and databases will help you get the most out of this book.

主要特點

• 理解並應用數據工程概念解決實際問題，並為DP-203認證考試做準備


• 探索各種Azure服務，構建端到端的數據解決方案


• 深入了解使用Azure服務構建安全可持續的數據解決方案

書籍描述

Azure是全球領先的雲服務提供商之一，提供眾多用於數據托管和數據處理的服務。如今，大多數公司要麼是原生於雲端，要麼正在以比以往更快的速度遷移到雲端。這導致了數據工程工作的激增，有志於成為數據工程師的初學者和有經驗的數據工程師互相競爭。

獲得DP-203：Azure數據工程師認證是向未來雇主展示您具備成為Azure數據工程師所需技能的一種可靠方式。本書將以結構化的方式幫助您準備DP-203考試，涵蓋課程大綱中指定的所有主題，並提供詳細的解釋和考試技巧。本書首先介紹Azure的基礎知識，然後以一家假想公司為例，引導您逐步了解構建數據工程解決方案的各個階段。在各章中，您將學習有關構建數據系統所涉及的各種Azure組件，並通過廣泛的實際用例進行探索。最後，您將使用示例問題和答案熟悉考試模式。

通過閱讀本Azure書籍，您將獲得通過DP-203考試所需的自信，並在數據工程領域實現夢想工作。

你將學到什麼

• 獲得Azure數據基礎設施的中級知識


• 設計並實施批處理和流式管道的數據湖解決方案


• 識別Azure存儲技術中可用的分區策略


• 在Azure Synapse Analytics中實現不同的表幾何


• 使用T-SQL、Spark和Azure Data Factory中提供的轉換


• 使用Azure Databricks或Synapse Spark使用筆記本處理數據


• 使用RBAC、ACL、加密、數據遮罩等設計安全性


• 使用調試技巧監控和優化數據管道

本書適合對象

本書適合希望參加DP-203：Azure數據工程師認證考試並希望深入了解Azure雲端技術堆棧的數據工程師。

本書還將幫助對Azure尚不熟悉或正在與使用Azure技術的公司面試的工程師和產品經理，獲得Azure數據技術的實踐經驗。對雲端技術、ETL（提取、轉換和加載）和數據庫有基本的理解將幫助您充分利用本書。

Newton Alex leads several Azure Data Analytics teams in Microsoft, India. His team contributes to technologies including Azure Synapse, Azure Databricks, Azure HDInsight, and many open source technologies, including Apache YARN, Apache Spark, and Apache Hive. He started using Hadoop while at Yahoo, USA, where he helped build the first batch processing pipelines for Yahoo’s ad serving team. After Yahoo, he became the leader of the big data team at Pivotal Inc., USA, where he was responsible for the entire open source stack of Pivotal Inc. He later moved to Microsoft and started the Azure Data team in India. He has worked with several Fortune 500 companies to help build their data systems on Azure.

Newton Alex在印度的微軟領導著多個Azure數據分析團隊。他的團隊貢獻了包括Azure Synapse、Azure Databricks、Azure HDInsight以及許多開源技術，包括Apache YARN、Apache Spark和Apache Hive在內的技術。他在美國的Yahoo期間開始使用Hadoop，並協助建立了Yahoo廣告服務團隊的第一個批次處理流程。離開Yahoo後，他成為Pivotal Inc.美國的大數據團隊負責人，負責整個Pivotal Inc.的開源技術堆棧。之後，他轉到微軟並在印度開始了Azure數據團隊。他曾與多家財富500強公司合作，幫助他們在Azure上建立數據系統。

Table of Contents

1. Introducing Azure Basics
2. Designing a Data Storage Structure
3. Designing a Partition Strategy
4. Designing the Serving Layer
5. Implementing Physical Data Storage Structures
6. Implementing Logical Data Structures
7. Implementing the Serving Layer
8. Ingesting and Transforming Data
9. Designing and Developing a Batch Processing Solution
10. Designing and Developing a Stream Processing Solution
11. Managing Batches and Pipelines
12. Designing Security for Data Policies and Standards
13. Monitoring Data Storage and Data Processing
14. Optimizing and Troubleshooting Data Storage and Data Processing
15. Sample Questions with Solutions

目錄

1. Azure基礎介紹
2. 設計資料儲存結構
3. 設計分區策略
4. 設計服務層
5. 實作物理資料儲存結構
6. 實作邏輯資料結構
7. 實作服務層
8. 資料輸入和轉換
9. 設計和開發批次處理解決方案
10. 設計和開發串流處理解決方案
11. 批次和管線管理
12. 設計資料政策和標準的安全性
13. 監控資料儲存和資料處理
14. 優化和疑難排解資料儲存和資料處理
15. 含解答的範例問題