Take your customers’ bots beyond Skype, Slack, Microsoft Teams and Facebook and bring them into the real world with Mixed Reality. Why simply type-chat with a bot when you could actually look at them, talk to them and listen to their answers? HoloBot is an open source reusable Windows Mixed Reality Unity project for Microsoft HoloLens that acts as a holographic client for a chatbot. HoloBot has already been used in the pharmaceutical industry at Merck where lab scientists can lookup procedure documents using voice and gestures, and review those documents as holograms visible in their work space. This session is a deep dive into this 3D app that lets users interact with a 3D avatar using natural language thanks to multiple technologies, including Cognitive Services Speech recognition & synthesis, Microsoft Bot Framework, LUIS, Unity, Windows Mixed Reality, and more.

You will learn:

• How to build an interactive avatar in 3D using Mixed Reality, Speech Recognition and Text-to-Speech
• How to build a custom Bot Framework channel using the Direct Line API
• How to build a speech-enabled conversational bot that is optimized for Mixed Reality integration