Kinect in Motion - Audio and Visual Tracking by Example

A fast-paced, practical guide including examples, clear instructions, and details for building your own multimodal user interface

Overview

• Step-by-step examples on how to master the essential features of Kinect technology
• Fully-functioning code samples ready to expand and adjust to your need
• Compact and handy reference on how to adopt a multimodal user interface in your application

In Detail

Kinect is a motion-sensing input device by Microsoft for the Xbox 360 video game console and Windows PCs. It provides capabilities to enhance human-machine interaction along with a zero-to-hero journey to engage the user in a multimodal interface dialog with your software solution.

Kinect in Motion - Audio and Visual Tracking by Example guides you in developing more than five models you can use to capture gestures, movements, and voice spoken commands. The examples and the theory discussed provide you with the knowledge to let the user become a part of your application.

Kinect in Motion - Audio and Visual Tracking by Example is a compact reference on how to master color, depth, skeleton, and audio data streams handled by Kinect for Windows.Starting with an introduction to Kinect and its characteristics, you will first be shown how to master the color data stream with no more than one page of lines of code. Learn how to manage the depth information and map them against the color ones. You will then learn how to define and manage gestures that enable the user to instruct the application simply by moving arms or any other type of natural action. Finally you will complete your journey through a multimodal interface, combining gestures with audio.The book will lead you through many detailed, real-world examples, and even guide you on how to test your application.

What you will learn from this book

• Tune the captured color data stream to adjust the output to the environmental condition
• Detect simple actions, such as arm movement, to raise events in your application
• Debug and test your application to increase the quality of the software delivered
• Track users wherever they are seated or standing so that your application can interact with the users
• Capture sounds to convert the vocal input into application commands
• Adjust the Kinect angle programmatically to optimize the view angle according to the user position and the environment characteristics

Approach

The book includes a series of step-by-step illustrated tutorials supported by detailed explanations for building a multimodal user interface based on Kinect for Windows.

Who this book is written for

Kinect in Motion - Audio and Visual Tracking by Example is great for developers new to the Kinect for Windows SDK, and who are looking to get a good grounding in how to master video and audio tracking. It's assumed that you have some experience in C# and XAML already.

一本快節奏、實用的指南，包含示例、清晰的指示和詳細的建立自己的多模式用戶界面的細節。

概述：
- 逐步示例，教授如何掌握Kinect技術的基本功能
- 完全功能的代碼示例，可擴展和調整以滿足您的需求
- 緊湊且方便的參考，教您如何在應用程序中採用多模式用戶界面

詳細內容：
Kinect是微軟為Xbox 360遊戲機和Windows PC開發的動作感應輸入設備。它提供了增強人機交互的能力，並帶您踏上一段從零到英雄的旅程，讓用戶與您的軟件解決方案進行多模式界面對話。

《Kinect in Motion - Audio and Visual Tracking by Example》指導您開發超過五個模型，用於捕捉手勢、動作和語音命令。示例和理論討論將為您提供讓用戶成為應用程序一部分的知識。

《Kinect in Motion - Audio and Visual Tracking by Example》是一本緊湊的參考書，教您如何掌握Kinect for Windows處理的顏色、深度、骨骼和音頻數據流。從介紹Kinect及其特性開始，您將首先學習如何使用不超過一頁的代碼行來掌握顏色數據流。了解如何處理深度信息並將其映射到顏色信息上。然後，您將學習如何定義和管理手勢，使用戶可以通過移動手臂或任何其他自然動作來指示應用程序。最後，您將通過多模式界面完成您的旅程，將手勢與音頻結合起來。本書將通過許多詳細的實例引導您，甚至指導您如何測試應用程序。

本書將教您以下內容：
- 調整捕獲的顏色數據流，以適應環境條件
- 檢測簡單的動作，例如手臂運動，以在應用程序中觸發事件
- 調試和測試應用程序，提高軟件交付的質量
- 追踪用戶的位置，無論他們是坐著還是站著，以便您的應用程序可以與用戶交互
- 捕捉聲音，將語音輸入轉換為應用程序命令
- 以編程方式調整Kinect的角度，根據用戶位置和環境特性優化視角

這本書包含一系列逐步插圖化教程，並提供詳細的解釋，以建立基於Kinect for Windows的多模式用戶界面。

這本書適合剛接觸Kinect for Windows SDK的開發人員，並希望在如何掌握視頻和音頻跟踪方面打下良好基礎的人。假設您已經有一些C＃和XAML的經驗。