Learn Azure Synapse Data Explorer: A guide to building real-time analytics solutions to unlock log and telemetry data

A hands-on guide to working on use cases helping you ingest, analyze, and serve insightful data from IoT as well as telemetry data sources using Azure Synapse Data Explorer

Free PDF included with this book

Key Features

- Augment advanced analytics projects with your IoT and application data|
- Expand your existing Azure Synapse environments with unstructured data
- Build industry-level projects on integration, experimentation, and dashboarding with Azure Synapse

Book Description

Large volumes of data are generated daily from applications, websites, IoT devices, and other free-text, semi-structured data sources. Azure Synapse Data Explorer helps you collect, store, and analyze such data, and work with other analytical engines, such as Apache Spark, to develop advanced data science projects and maximize the value you extract from data.

This book offers a comprehensive view of Azure Synapse Data Explorer, exploring not only the core scenarios of Data Explorer but also how it integrates within Azure Synapse. From data ingestion to data visualization and advanced analytics, you'll learn to take an end-to-end approach to maximize the value of unstructured data and drive powerful insights using data science capabilities. With real-world usage scenarios, you'll discover how to identify key projects where Azure Synapse Data Explorer can help you achieve your business goals. Throughout the chapters, you'll also find out how to manage big data as part of a software as a service (SaaS) platform, as well as tune, secure, and serve data to end users.

By the end of this book, you'll have mastered the big data life cycle and you'll be able to implement advanced analytical scenarios from raw telemetry and log data.

What you will learn

- Integrate Data Explorer pools with all other Azure Synapse services
- Create Data Explorer pools with Azure Synapse Studio and Azure Portal
- Ingest, analyze, and serve data to users using Azure Synapse pipelines
- Integrate Power BI and visualize data with Synapse Studio
- Configure Azure Machine Learning integration in Azure Synapse
- Manage cost and troubleshoot Data Explorer pools in Synapse Analytics
- Secure Synapse workspaces and grant access to Data Explorer pools

Who this book is for

If you are a data engineer, data analyst, or business analyst working with unstructured data and looking to learn how to maximize the value of such data, this book is for you. If you already have experience working with Azure Synapse and want to incorporate unstructured data into your data science project, you'll also find plenty of useful information in this book. To maximize your learning experience, familiarity with data and performing simple queries using SQL or KQL is recommended. Basic knowledge of Python will help you get more from the examples.

這本書是一本實用指南，幫助您使用Azure Synapse Data Explorer從物聯網和遙測數據來源中提取、分析和提供有見地的數據。本書附有免費的PDF版本。

主要特點包括：
- 使用您的物聯網和應用程序數據增強高級分析項目
- 通過添加非結構化數據來擴展現有的Azure Synapse環境
- 使用Azure Synapse在整合、實驗和儀表板方面構建行業級項目

書籍描述：
每天從應用程序、網站、物聯網設備和其他自由文本、半結構化數據源產生大量數據。Azure Synapse Data Explorer幫助您收集、存儲和分析此類數據，並與其他分析引擎（如Apache Spark）一起使用，開發高級數據科學項目，並從數據中提取最大價值。

本書全面介紹了Azure Synapse Data Explorer，不僅探討了Data Explorer的核心場景，還介紹了它如何與Azure Synapse集成。從數據輸入到數據可視化和高級分析，您將學習採用端到端方法，最大限度地發揮非結構化數據的價值，並使用數據科學能力獲得強大的洞察力。通過真實世界的使用場景，您將發現Azure Synapse Data Explorer如何幫助您實現業務目標的關鍵項目。在各章中，您還將了解如何將大數據作為軟件即服務（SaaS）平台的一部分進行管理，以及如何調整、保護和提供數據給最終用戶。

通過閱讀本書，您將掌握大數據生命周期，並能夠從原始遙測和日誌數據實施高級分析場景。

學到的內容包括：
- 將Data Explorer池與所有其他Azure Synapse服務集成
- 使用Azure Synapse Studio和Azure Portal創建Data Explorer池
- 使用Azure Synapse管道將數據輸入、分析和提供給用戶
- 將Power BI與Synapse Studio集成，並可視化數據
- 在Azure Synapse中配置Azure Machine Learning集成
- 在Synapse Analytics中管理成本和疑難排解Data Explorer池
- 保護Synapse工作區並授予對Data Explorer池的訪問權限

本書適合數據工程師、數據分析師或業務分析師，他們處理非結構化數據並希望學習如何最大限度地發揮此類數據的價值。如果您已經有使用Azure Synapse的經驗，並希望將非結構化數據納入您的數據科學項目中，本書也提供了豐富的有用信息。為了最大化學習效果，建議您熟悉數據並使用SQL或KQL執行簡單查詢。基本的Python知識將有助於更好地理解示例。

1. Introducing Azure Synapse Data Explorer
2. Creating Your First Data Explorer Pool
3. Exploring Azure Synapse Studio
4. Real-World Usage Scenarios
5. Ingesting Data into Data Explorer Pools
6. Data Analysis and Exploration with KQL and Python
7. Data Visualization with Power BI
8. Building Machine Learning Experiments
9. Exporting Data from Data Explorer Pools
10. System Monitoring and Diagnostics
11. Tuning and Resource Management
12. Securing Your Environment
13. Advanced Data Management

1. 介紹 Azure Synapse Data Explorer
2. 建立您的第一個 Data Explorer Pool
3. 探索 Azure Synapse Studio
4. 實際應用場景
5. 將數據載入 Data Explorer Pools
6. 使用 KQL 和 Python 進行數據分析和探索
7. 使用 Power BI 進行數據可視化
8. 構建機器學習實驗
9. 從 Data Explorer Pools 導出數據
10. 系統監控和診斷
11. 調整和資源管理
12. 保護您的環境
13. 高級數據管理